I think that penny is more prep.
However there are different "penny" loafers.
The original penny with moc construction is very casual.
The welted penny like alden lhs, C&J version and others are nice and more versatile.
There are then sleeker and refined penny loafers that are too dressier to be used for casual / informal wear.