Lots of people with opinions here huh. I think it flatters you more if you end your posts with a simple "IMHO".
Personally, I think the whole idea that no one under 60 can wear a hat is BS. I wear hats all the time, lots of my friends do as well. If it works or not depends on whether you look comfortable doing so, and if it's appropriate for the lifestyle you lead.