Looking to buy a Bedale. Can't decide if I want the 38 or 40. The 38 is definitely more fitting, while the 40 is definitely roomier and easier to put on. I had on a undershirt, chambray, and a wool sweater. Which, is probably the most I'd wear under it. Thoughts/ opinions?