The medium on the model fits like yours but he's 160 pounds. Might be pushing it considering the large isn't too baggy. The sleeves might look better though.I'm like you though with sizes. I'm between a medium and and a small. I have about 10 JE tees and I mix it up with the sizes. Some are small ans some are medium.