A lot of people use scarves as an accessory and if you're comfortable with that its fine. Others use it purely as defence against the cold which is fine too. Do whatever you feel comfortable with. (I never said you look uncomfortable btw.)
Personally I use scarves against cold. If its cold and I'm gonna wear a scarf it might as well be a nice one but I'd never wear a scarf just for te sake of wearing a scarf. That doesn't mean others can't tho. I just think scarves as an accessory look effeminate but thats just my personal opinion. (Actually, I think almost all accessories other than a PS look effeminate.) I also would't wear swimms over my wellies but if others want to thats fine.
The difference (for me) between a scarf and a PS or boutonnière is that the former originally was intended to serve a functional purpose and the latter two were always intended to be accessories.
and GDL, it just looks too much, like it was intended just for the sake of over doing it. minus the scarf and sunglasses. it's a good fit.