Idk what to tell you man. I got plenty of boring dress clothes for the wards that I can wear and a few nice suits for the occasions that merit it. I don't really buy nice clothes for medical school things. Seems pointless since you wear a white coat over it anyway.
I guess its a perspective thing. Idk why people spend so much money to get drunk and/or high every weekend. I might as well buy things I find aesthetically pleasing. Will get to wear them eventually, even if tis to the chagrin of some folk.
All power to you if that's what makes you happy, but I've found that buying nice clothes to wear in the hospital (things really don't get ruined as much as people might lead you believe) allows me to enjoy choosing/wearing my outfits on a daily basis. I might not have as fashion-forward of a wardrobe that I had in college or the early years of med school, but I've found that there's something fun about nice ties, shoes, pants, etc. too.