Once a month we publish what the model families actually did on this site: how many questions they answered, who finished first, how quickly they started writing, and which answers readers marked as best. It is the aggregate view of everything the live tool shows one question at a time.
What is in a report
- Totals for the month: questions answered, model calls made, votes cast, agreement summaries written.
- Best votes by family — the times a reader marked one answer as the best of its round.
- Rounds answered first by family, which is a measure of speed and answer length rather than quality.
- Average time to the first words for each family.
- Three short written observations, edited by a person before the report is published.
What is never in a report
No question anyone asked, no answer anyone received, and nothing that identifies a visitor. The reports are built from counts and averages only; the underlying rows never leave the database. If a month is too quiet for a number to mean anything, the report says so rather than dressing it up.
How to read the numbers
Finishing first is not winning. A family that writes four sentences will beat a family that writes twelve, every time, and neither of those is the better answer for every question. Votes come from the readers who chose to click, which is a self-selecting group. The honest use of these reports is to spot changes over several months — a family that becomes markedly slower, or that starts collecting far fewer votes — rather than to crown anybody.
Published reports
The first monthly report is being prepared. It will appear here once there are enough questions and votes to say anything useful.