Claim Hunt Find every planted false claim in the report.

—

Before you start

How it works
  1. Flag a sentence only if it is clearly wrong. A fact, formula, definition, or mechanism you could state correctly, with nothing left to argue about. Click it to flag, click again to undo.
  2. Don't worry about wording that is just imprecise, oversimplified, or a bit strong. Save your flags for clear, checkable errors.
  3. Take your time. You won't see how you did until you Submit.
  4. Hit Submit when done, optionally note why on each flag, and you'll see your results.

Feel free to look things up. Search the web, open the papers, check the docs, and take the time you need to be sure.

Just don't ask an AI assistant (ChatGPT, Claude, etc.) to find the errors for you. We're measuring your judgment, not the model's.

Examples: what counts as a clear error
“Proximal Policy Optimization (PPO) was first introduced by DeepMind in 2015.”
False claim A specific, checkable fact that is simply wrong: PPO is from OpenAI (2017). When you know it's wrong, use False claim.
“Proximal Policy Optimization (PPO) is fundamentally an off-policy reinforcement learning algorithm.”
False claim A definitional error you can settle from understanding alone. PPO is on-policy, optimizing with data from the current policy. No lookup needed, so use False claim.
“The method improves accuracy by 9.3%.” (the paper actually reports 9%)
Doesn't count this round A number that's only slightly off, where you'd need the exact source to be sure. In this round a small discrepancy like this does not count — flagging it or leaving it won't change your score, so don't stress about catching it.
“By removing the value network, GRPO completely eliminates training instability.”
Doesn't count this round “Completely” is too strong, but this is an overstatement rather than a clear factual error. Borderline wording like this does not count this round either way.
0:00 · 0 flagged
Flag a sentence only if it is definitely wrong: a checkable fact, formula, or mechanism you could correct. Leave vague or overstated wording alone. Submit when done.

Add your notes

Notes are optional. A line on why you flagged each one helps us a lot.

Results

Don't take the score to heart. The “correct answers” are imperfect right now. If you disagree with one, tell us below.