Originally Posted by Don Carlos
Wear only the emblems of organizations to which you belong. Polo emblems or Brooks Brothers emblems are tacky.
This is always solid advice. I think with "statement pieces" like emblematic ties it looks quite gouache to wear the crest of something you have no affiliation with. I consider it on par with wearing another man's initials embroidered on your shirt/cuff.
That said I have a few emblematic/club ties (fraternity, alma mater and social/country club) that I enjoy wearing in more casual situations or when I am present at a gathering where the ties will be recognized and appreciated.