Don't get me wrong, I don't think it's terrible. But a lot of SFers have ended up with jumbled wardrobes because they bought items that were good enough rather than just plain good. You don't need to do that.
If you dig it with wider lapels, great. But I'd urge you to give it a hard look and decide if it's your preference -- to your taste -- rather than keep it because it could be worse.
Playing Devil's advocate: Hasn't the intended lesson been to buy things that best suit him, rather than settle for the less-than-ideal? SF-approved items that don't suit are no better than NM items that don't suit, IMO.
I like knits, so I have no desire to discourage folks from wearing them. But I question the sense of obligation. Once you're in denim, you've made the call on formality. In that case, I'd say, add a knit if you think it adds to the effect, but not because of what you're doing. Here, I'd like the laid-back vibe that would accompany an open collar.
R, you seem to have returned a lot of stuff already. If you're on the fence about some of the remaining items -- particularly those outside the exchange terms -- I'd suggest considering how generous Neiman already has been to you. The suit, especially. There's a point at which taking advantage of a generous exchange policy becomes abuse. You bought it, after all.
Used to be you could return anything at Brooks anytime, but people took excessive advantage of that fact. Now...