For me, something should be notable. There should be contrast, color, design...something. For example, I'll wear a neutral gray suit + bland shirt...+ a brightly colored tie (bllue & orange, for example). Another example is a "safe" suit + shirt + tie ...+ vest (vest being the "something extra"). Nothing I sport is outside the realm of acceptable, but it's definitely less than usual. Be noticed.