Believe in your own style choice!
Be confident! Everyone will have different opinions, take them as your references only, don't care too much
Try not to change the whole look at once but maybe just add on a more formal jacket/blazer to match with jeans and t-shirt
You know what, even you change yourself according to others opinion, there are still more opposite comments
Just let it be and be the most comfortable you!