I'd say use. I keep my wallet, Swiss army knife, spare change, and keys in my left front pocket (the pocketbag I wore through), and it probably gets more use than the right pocketbag (cell phone and Burt's bees). I'm guessing the keys were a major contributor to the eventual breakdown of pocketbag integrity.
I hear you about how difficult these pocketbags are to use. I have pretty big hands, and it can be a serious challenge to get my forefinger and thumb, much less my whole hand, into the pockets.
It's extra-tricky because of how deep the pocketbags are, at least compared to most of my other jeans.