Macs are the only pair of AEs I currently own so I should feel bad but the more I read and the more I try to wear them with different things, I know exactly what you mean. IMO they are great with some khakis/button down and okay with jeans but I feel funny wearing some BB dress pants with them. the rough look just doesn't work well. No one probably cares but it bothers me.
I hope to get another pair of (less conflicted) shoes soon.
Pro: -leather sole (at least I am not rocking goofy thick rubber soles like on haans).
-nice shape (I like the rounded toe. it is not square and tacky and it is not pointy)
-they fit perfectly and feel great with a short break in
-cognac color is pretty nice
-they has served as a gateway drug to better shoes
con-the "rough" leather just doesn't let you dress them up.
-even though a casual shoe people thing they are wing tips and therefore dressy
-contrast stitching (I didn't notice before and now I wish they didn't have it)
There are more pros and cons I am sure but all that said, they have been good to me overall.