Your post is great evidence of the advice everyone is giving about confidence is being key to the way you dress: you can pull that look off, while most others your school wouldn't dare to. I guess the girls pick up on that daring attitude and find it confident and attractive, so lucky you. I've got compliments from random girls (even one walking with her boyfriend.. which was suspect) on how I dress day to day at university, I try to stand out, but to not go over the top.
I agree with dressing within 1 or 2 standard deviations above the norm, I think that you should be the best of what's expected of your age demographic.
But one thing many members of the forum need to keep in mind: Our perception of what's stylish is a lot different from what the majority of women think is. Fashion sense gets better with age for both genders, so college age girls are usually not very stylish, due to them still being in "high school conformity mode". They grow out of it eventually, but until they see how men in the real world are supposed to dress, women will usually pick a guy based on his physical appearance and apparent wealth, not on his fashion sense. Fashion sense usually has no place in college, most girls just do not look at men's clothes the way this does. Dressing well is that little edge you can give yourself to standing out from a guy who is equal to you in the departments I discuss later. They look for physical appearance factors before they dissect clothing choice, if they even have enough time to get that far. Seriously, if you want to attract girls in college, hit the gym, get comfortable talking to women, dress slightly better than average, and learn to dance better than average, in that order. Not saying this will net you a good girlfriend or whatever, this will probably get you a few one-night stands if you're lucky, but you will think more highly of yourself after you gain more muscle, are more confident talking to girls, are comfortable looking good, and comfortable on the dance floors. This will have a snowball effect with your confidence level. Also, appearing to have a brain wouldn't hurt, but I find that dress sense is correlated with intelligence to some degree.
This is all from advice from girls I know, and my own thoughts mis-mashed together.