It’s worth remembering that the blazer is usually regarded as the dressiest of odd jackets. That its relative formality thus approaches that of the suit isn’t surprising, and personally the ‘looks like it could be a suit jacket’ effect doesn’t worry me as much. YMMV.
Also, I'm learning a lot from the ensuing debate. Thanks, gentlemen.