It's funny how people here are saying "you dress too old for your age", &c., and then they're simultaneously saying "you need to develop your own style". And then they start whining like little bitches just because you won't jump when they clap.
People here have also been ridiculously callous regarding your body shape. You have wide hips and quads: you clearly can't wear particularly slim trousers. And those saying "you need to go to the gym to build up your upper body"; well sure, go ahead and spend 6 hours a week in the gym if you want to force yourself into that mould. But you strike me as an intelligent man with personality, who doesn't want to fit no fucking mould. I would take a guess you'd rather spend your time re-watching Sergio Leone's "Dollars" trilogy. Besides, my friend has wide hips and spent three years in the gym; he now has a 48 inch chest and a 34 inch waist. But he still has wide hips and certainly can't wear slim trousers.
With that preface in mind, this is my advice:
1. Wear more navy and deep blue. Particularly your more formal clothing. It's a youthful colour that looks modern and classic simultaneously. It's also extremely flattering on your body.
2. Someone suggested taking your clothes to a tailor. I concur. A good tailor will tell you where things need to shortened, slimmed, balanced, etc.. Suits, shirts, blazers, and trousers will all benefit hugely.
3. Try to buy clothes made of high quality, soft fabrics where possible. The way they lay on your body is extremely flattering.
4. Take your photos of your fits in a nicer room. Preferably a white room/wall with natural or at least good light. This alone will make a huge difference to the advice people give you here.
I don't see a disconnect here. OP should be encouraged to develop his own style, but within the context/framework of being a 22 year old. There are many possibilities within that framework that can work well. After losing the try-hard fedora, and then paying careful attention to fit, color, and quality of everything else, he can still look like a conservative 22 year old without looking like his grandfather.
Also, as much as you like to hate on gym-goers, it remains the single most effective way to improve your appearance, and as long as you're making efficient use of your time while in the gym and eating right while out of it, it doesn't take 6 hours a week.