I feel like I am in between 31 and 32 waist size--31 is a bit tight on me, whereas 32 feel a bit loose. What would you recommend? Should I go with bigger and hope that if I need it smaller I can take the waist in? Or should I go with smaller and hope that it will feel looser as I break the pants in and wear it? Thanks.