I never even considered holding someone's bag an issue. I'll hold Erica's bag if she's tired, because... well, I care about her comfort. I can't recall one single time when someone's questioned my manliness (lolz). I think that not being considerate of your SO, because of an overwhelming fear of appearing feminine, is a pretty un-manly trait.
Otoh, she almost never carries a regular handbag.