The double jersey shorts are the thicker ones I believe correct? Same material as the sweat pants?If so they fit slightly big as far as how W + H stuff normally fits. I'm about a 33 waist (33 in the Westpoint chino shorts) and got a large in the double jersey shorts online, though could have easily gone to a medium. Depending on fit, you could probably go either small or medium. They do seem to fit slightly long, just as a heads up.