To cuff (or to turn-up) or not to cuff is purely a personal choice. There are some 'guidelines' - they are usually but not exclusively more congruent with pleats than flat fronts, and some wisdom suggests the weight of the cuff adds to the effect of the trouser legs hanging nicely, but don't listen to any prejudiced views of SF its up to you. I would guess that cuffs are probably more popular on here but I never wear them myself, as like you I associate them with old geezers!
I wouldn't put it as bluntly as you put it but that's been my perception too.
But still, this is something that I should look into.