Lot's of good advice here, from upgrading your clothes at their present level of formality to migrating over time to a more appealing personal standard of formality.
One start-up I am working with is very informal, yet I merely hang my suit jacket behind my office door when working there. When the board for this company meets, I remove my tie and replace my suit jacket as most board members for this company wear a suit and dress shirt, but no tie despite the very high quality and elegance of their attire. Many clients of this start-up also dress in a similar manner since they arrive directly from the nearby airport or they have adopted this standard of business dress due to locale of these offices.
Be that as it may, I am always ready for any meeting, business or social, due to my personal standards of formality for business wear, which includes the wearing of a conservative suit and tie together with elegant shoes and accessories with a well worn patina. A few things have changed over the years as I almost never wear a watch unless hunting in the field [so that I don't run afoul of local hunting regulations on the beginning or end of day] and no longer do all my suits require the wearing of suspenders/braces, but only most.
The nice thing is that when I travel to other operations or meet clients or acquaintances, socially or at their place of business, I am always properly attired for any possible occasion below black tie formality while meeting my own personal standards of business dress. Since many current formal events have optional standards and since many attending wear something other than a black bow tie, I am never denied access to any event or given a second glancem even when it is impossible for me to change into evening wear due to mitigating factors. I merely plan ahead such that I am wearing one of my charcoal solid suits with a white shirt and suitable tie for a particular day where an evening event is planned and I might not be able to change my evening attire.
My preferred standard of business dress has provided me over the years an unending stream of opportunities, benefits, privileges, and favors far too long to list, from present business engagements to romantic encounters to service upgrades and first class privileges to lifelong friendships to a nod and a wink.
If you dress differently and in the right way while conducting your business, you'll never escape notice, opportunity, and good fortune. You have my word on it.