So you'd wear black shoes with a seersucker suit? Cream linen? That's a good way to look like an idiot.
You're talking about an artificial rule that's nowhere near universal, and in many contexts makes absolutely no sense. I have nothing against black shoes, unlike many here, but I'm going to ignore any absolutist pronouncement about what always must be the case and go with what actually makes sense for a given situation.
Seersucker suits and white bucks are good enough for the US Senate (they used to be de rigor in summer, now with a/c they're more of a fun thing), they're good enough for me.
we can stop here...