Anyways, pick something you like and can make enough to easily pay off any college debts you'll have.
For me, I absolutely love car design, but I wouldnt be able to make a living with it, so I chose my second biggest passion, which is finance. Luckily, finance pays well, so that works out well.
I don't know how much a menswear buyer makes or what the career trajectory is, but I'm sure others could chime in. I'd say experience is more important than education for any business, so try networking and getting an internship there as well. Just cold email people and then call them if they agree to call, ask friends, whatever. You'd be amazed how far you can get by doing that. I mainly managed to get one of the 50 available positions out of 12,000 applications by doing that. So don't overestimate your competition.