I picked it up on here (maybe on AAAC?). "Fit" has never sounded right to me, and I don't particularly like the word "outfit." I've heard "pile" used, too, but that never clicked for me.
I think you may have pushed me over the edge on picking up a pair of dark brown chelseas, too. I'm starting to think they're cover the whole range of formality I regularly wear.