I wear rugby shirts a lot in winter for casual wear (I've seen them called the polo shirt's cousin). Â They're one of the few casual, long-sleeved shirts that I can find in "tall" sizes. Â Don't have any sources of high-quality rugby shirts, though. Â I buy them whenever I find one that fits.
Patagonia still makes a Rugby shirt. It was one of their first items. And it's been, in my experience, bullet-proof.