Times certainly have changed from when that song was written. At 53rd Street and Third Avenue you'll now find the Citigroup building and other tall skyscrapers.
http://www.kauhajoki.fi/~jplaitio/ramoneal.html
53rd and 3rd Standing on the street
53rd and 3rd I'm tryin' to turn a trick
53rd and 3rd You're the one they never pick
53rd and 3rd Don't it make you feel sick?