I wear French cuff shirts with sweaters, but I fold the cuffs together in a circular shape that mimics a barrel cuff, and hold either end together by securing them with small silk knots. This way, the cuffs will not bend the sleeve ends of the sweater out of place. Plus, I do not show cuff when wearing a sweater, thus I do not care if the French cuffs are not worn properly, no one can see / tell anyways. At the same time I wear cutaway shirts with French cuffs (that are tapered on either side, and have been shorten at the hem by my tailor, so it has the proper length and shape when worn outside of the pants) with jeans. Of course, when approaching this sporty look, I only use silk knots, and other cuff links would ruin the look by not being sporty enough and looking too dressy. Jon.
For Myself, I wear French cuff shirts with cufflinks with a sweater on . I do not see it as much of a problem at all. If it is a hot day, I unfasten the cufflinks, fold them into the cuff and fold the sleeves back twice. (been doing it for years and not lost a link , yet!
Jon, If you novelty cufflinks with the sporty casual look I suggest to you that that would look really neat with the shirt worn untucked with Jeans. Stuarts8