Look around here and check out the shops that everyone talks about (online of course since you can't visit them all personally obviously). My personal favorite is Context because they are local and I am able to go in there and check stuff out. I buy most of my clothes from them these days. Also check out Epaulet, Self Edge, Union Made, Inventory, Drinkwaters, and lots more you can learn about here.
As far as what I've moved onto, well, lots of different stuff. Brands in my closet now include: Gitman Vintage, Engineered Garments, Epaulet, RRL, Sunny Sports, Sugar Cane, Iron Heart, KMW, W+H, APC, Somet, and Dry Bones. I have a couple J Crew shirts left that get some wear occasionally, and a fatigue jacket that I actually like surprisingly well and wear often. In general they are more expensive but have higher quality materials and construction as well as more unique styles and fits in some cases.
I think you can look decent dressed by J Crew, but you'll look like lots of other guys who wear the same stuff. You'll also be settling for shirts of decent but unremarkable quality. If all you care about is looking decent, then don't worry about it. I think J Crew makes that easy for the average guy who doesn't really care much beyond that. Chances are however, since you're here, you care about more than just looking decent. You have an interest in clothes and probably in the quality, design, fit and fabrics of them. If that is the case do yourself a favor and explore what all is out there. There is a lot.
