One somewhat more subtle reason New York sucks, based on just getting back from two weeks in Japan:
It spoils the shit out of you and makes you into a snob.
We flew halfway around the world, get to Tokyo, and my first thought is "meh, this is just a cleaner New York with a functioning transit system and weird people living in it." We are eating at these restaurants that are supposed to be among the best in the world, both fine Michelin-starred dining and more humble fare, and with a few notable exceptions, I can't shake the feeling of "meh, I have had this, just as good, in New York, and there, the wine selection is better and isn't outrageously expensive."
I do have to say, they did nail the transit system though--it was incredible and eye opening. Not just the infrastructure itself (you mean the trains are clean, have countdown timers, come every three minutes, and have an average system-wide delay of less than 30 seconds? How is such black magic possible?), but the people themselves actually knew how to ride the damn train--stand to one side on stairs and escalators, move ALL THE WAY into the car, etc.
We had a great time, but I was ready to get back home, where I could enjoy most of the same things, but speak the language and understand the culture well enough to yell at people who are behaving like idiots.
Don't get me wrong though, I still fucking hate New York. As if to drive it home, my train has been a clusterfuck the last two days, and the MTA announced they are going to start doing major work on the F line later this year.