We are constantly evaluating fits on SF, but usually as a part of a conversation. This means that consensus is often driven by early influential posters followed by a lot of groupthink. Dissenters may not feel confident enough in their opinions to speak up. Likewise evaluation of a given fit may depend heavily on who posts it.
With this simple project I'd like to do something different. Whoever wants to can "register" as a judge by responding ITT or PMing me with the subject line "Judge Volunteer". Registration will be open until next Monday night or until I have 100 judges, whichever comes first. Next Tuesday I will send 10-20 fits (not mine, or at least no more than one of mine) to these judges, who will respond to me privately, with no discussion in this thread or elsewhere. I will choose pictures that are not SF-recent nor SF-famous, nor perhaps even SF at all, in order to minimize contamination of the jury.
With the results, I will then summarize 1) the degree to which there is consensus among the judges 2) what judge characteristics influence ratings (post count, location, forum tenure, etc) 3) to the degree possible, what kinds of fits get high ratings. Judges will also be allowed to send me comments along with their ratings, which I will try to summarize where interesting.
I will never reveal any judge's identity, ratings, or comments, although after the judging period is over they are free to do so on their own.
So summary:
- respond or PM if you want to judge fits
- you will not be able to seek outside counsel to inform your ratings
- your anonymity will be protected and ratings kept confidential
With this simple project I'd like to do something different. Whoever wants to can "register" as a judge by responding ITT or PMing me with the subject line "Judge Volunteer". Registration will be open until next Monday night or until I have 100 judges, whichever comes first. Next Tuesday I will send 10-20 fits (not mine, or at least no more than one of mine) to these judges, who will respond to me privately, with no discussion in this thread or elsewhere. I will choose pictures that are not SF-recent nor SF-famous, nor perhaps even SF at all, in order to minimize contamination of the jury.
With the results, I will then summarize 1) the degree to which there is consensus among the judges 2) what judge characteristics influence ratings (post count, location, forum tenure, etc) 3) to the degree possible, what kinds of fits get high ratings. Judges will also be allowed to send me comments along with their ratings, which I will try to summarize where interesting.
I will never reveal any judge's identity, ratings, or comments, although after the judging period is over they are free to do so on their own.
So summary:
- respond or PM if you want to judge fits
- you will not be able to seek outside counsel to inform your ratings
- your anonymity will be protected and ratings kept confidential
- this is possible but I'm pretty sure I got it from cutter and tailor somewhere. It definitely wasn't a 
![lurker[1].gif](http://files.styleforum.net/images/smilies/lurker%5B1%5D.gif)
