Stick with brown if you're wearing with jeans, black looks bad against the blue. A black loafer actually has an incredibly limited range- black, olive or gray odd trousers, olive or gray khakis (since black is an abomination against the lord and you shouldn't be wearing them anyway). They look great with black or gray jeans too, but those aren't exactly staples of most people's wardrobes.
Black shoes are best purchased with laces for that reason- they'll work with most of the above scenarios, but will also work with suits in those colors.
