They made those super destroyed jeans in men's sizes also. Not sure if they are still available anywhere. I know the regular destroyed are still available as I grabbed a pair from the Chicago store yesterday. If you call one of the stores they can check for you.
I'm even skinnier than you, with a 30in chest, and unfortunately I haven't found any company that fits like Dior Homme. Their sweaters in a xxs and suits/jackets in a 40/42P fit perfectly. For dress shirts though you should give Jantzen a try if you haven't already. For sweaters you might want to try some of the Japanese brands like Lad Musician and Julius.