A big +1 to all the comments about being presumed arrogant, assholic, intimidating, gay, and dickish.
Then again, maybe it's because when someone compliments what I'm wearing, my stock reply is "Thanks, now get off my dick, townie."
I have learned to be more comfortable toning it down, though. To actually forego the sport coat from time to time when going out was a big step for me. I've found I've been more popular since. Or, you know, as popular as a disdainful prick can ever be.
ime, the sport coat has been a death sentence if worn after 9pm. not only do I stand out like a sore thumb amongst my coworkers, but now It appears that I belong with the group of suited gents huddled in the corner smoking cigars.