OK, here are the instructions I gave the judges, so you'll know what they were told and what data I have:
Quote:
Thank you again for agreeing to participate in this project. The only part that is absolutely necessary is that you give a rating to each pic, from 1 to 10.
Think of each pic as being someone you see on your way to work in the morning. A rating of 1 means you think they look terrible. A rating of 10 means you think they look amazing.
Inevitably each judge will have a slightly different scale, but try to think of 3 as average compared to the guys you see wearing ties in the morning, 6 as 75th percentile, 8 as 90th percentile, and 10 as you don't know if you've ever seen anybody look that good. You may give ratings that are not integers, for instance, 3.7, 8.5, etc..
In addition, you may add comments. Separate these out into two categories. Label the first "Reasons" and include any justification or reasoning behind why you gave a particular rating. Things you liked, didn't like, etc.. Label the second "Impressions" and describe what impression this person gives off to you - laid-back, funny, austere, pretentious, self-centered, etc..
Wherever there are faces, I have obscured them. I have tried to choose pictures that are not immediately recognizable. If you recognize a picture, or notice some clues that give you an idea of where it comes from, try to ignore these as much as possible and focus just on what you see in the picture. If you do recognize a picture or an individual, please make a note of it in your comments.
Finally, and this is entirely optional, it would be interesting to have some minimal demographic information on each judge. When you submit your scorecard, if you don't mind sharing your:
Age
Income range (<$50k/yr; $50k-100k/yr; >$100k/yr)
Highest academic degree attained
Location (city or town is fine - but if you're in a suburb as opposed to the city itself, please note that)
that would be helpful. Once again, this part is entirely optional. These data might be published in aggregate form, but will never be publicly identified with your scorecard or your screenname. In no way will your responses be weighted more or less heavily based on your answers or non-answers to these questions.