CheckThat!
Benchmarks
TaskDatasetSOTA resultTrendResults
CheckThat! S (100+/100+) 2021 re-annotated (dev)
57.9Agreement
5
CheckThat! Task 1 (French) 2026 (dev)
77.72MRR@5
2
CheckThat! Task 1 (German) 2026 (dev)
0.66MRR@5
2
CheckThat! Task 1 (English) 2026 (dev)
0.717MRR@5
2
CheckThat! S24_con 2021 re-annotated (dev)
58.4Agreement
2
CheckThat! Task 1 2026 (test)
0.782MRR@5 (EN)
1