Flyswatter, I would return them. If it bothers you now, just return them and avoid wearing them out and regretting it. For $345 you deserve to be completely satisfied.
This is unfortunately not uncommon in AE shoes. I don't know what they do, but it happens a lot. Hopefully a replacement pair is of better quality.
Thanks for the comments. Two opposing opinions... lol. On the one hand, I do tend to get unnecessarily anal over small things, but then again like gsgleason said, for $345 (actually I paid slightly less for that with the "Soles for Souls" discount), I should be completely satisfied. I should be able to make it to an AE store within the next couple weeks, so maybe I'll take them there and try to find a pair that doesn't have this problem.
Any other thoughts?