You'll see posts from X, each with two proposed Community Notes. Community
Notes add context to posts that might be misleading. Your job is to say
which of the two notes is more helpful.
What this involves
27 comparisons, about 25 minutes. There's a progress
bar, and you need to reach the end to be credited.
You won't be told which note came from where, and there is
no answer key we're scoring you against.
Some posts are a reply to or a quote of
another post. When they are, that other post is shown above for context —
but the notes are about the post being rated, the one at the bottom.
Where a post has an image, it is shown with the post —
judge the notes against what the image actually shows. Video is not
played; you get its first frame, labelled as such.
Please open the linked sources if you're unsure — that's expected, and
we record link clicks so we can tell it apart from leaving the page.
Please don't use ChatGPT or any other AI
We're measuring what people find helpful. An answer produced by an
AI assistant is worse than no answer at all, because it quietly biases the
result we're trying to measure. Please answer as yourself, even when you're
unsure — "I'm not certain but I'd pick this one" is exactly the data we
want.
Data and quality checks
We record your answers, how long each one took, and basic page events
(clicking a source link, copying text, leaving the tab). We do not
record what you type anywhere else, and we don't collect your name,
email, or IP address.
A few comparisons are attention checks with an obviously
off-topic note. They're there to catch clicking-through.
If your responses don't pass these checks we may exclude them from the
analysis. This does not affect your payment — if you
reach the end you are credited in full either way.
Your answers are used for research on automated fact-checking and
reported only in aggregate.
Two quick questions
Your name
Used only to keep your place, so you can close the tab
and come back. Any nickname works — just use the same one each time.
How often do you use social media (X, Facebook, Instagram, TikTok…)?
The task is about posts on X, so we're looking for
people who use social media at least sometimes.
In general, where would you place yourself politically?
The study compares how the notes land across the
political divide, so this one matters. It is stored with your ratings.
Original post
The post
Which note is more helpful?
Note A
✓ CHOSEN
Note B
✓ CHOSEN
How confident are you in that choice?
Last question — and it doesn't affect your payment
You've finished all the comparisons. Before we credit you, one honest
question, asked because knowing the true rate helps us interpret the
results.
Did you use ChatGPT or any other AI assistant for any of these
comparisons?
Answering yes will not reduce your payment, will not be
reported to the panel, and will not be held against you. We would genuinely
rather know.