The large is slightly roomy for my 38-39" chest, so I'd definitely go for a medium if I had a 36" chest. However I don't know if the two styles fit the same.
perhaps it (whatever piece your talking about) was made to stretch when worn? I wouldn't recommend someone with a 36" chest buy a medium in anything. I'm a 36 btw