In a similar position to you, I wore a pretty good range of stuff. Jeans and cords for the pants, tweed blazers and sweaters, with sport shirts (tweed can work with pretty casual shirts), oxfords and the like. Button down collars all the way. I mixed in a leather jacket, and a canvas one. Footwear was typically loafers, bucks, boat shoes, and the occasional wingtip or sneaker in summer.
Skip the ties as a daily thing.
You can dress well, but casually. With how slovenly most students are, going too formal is something you want to avoid.
fight fire with fire!
wear ties to fight those slackers.