Whereas I do respect the varied opinions offered on this subject by various gentlemen, I think it is completely reasonable to wear oxfords, especially brogued oxfords, with less formal wear. As for a black captoe, whereas I'd not wear it with jeans or shorts, they work as great evening wear with anything slightly dressy.