Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

ArxivRollBench dataset and benchmarks · SOTA2 Research

Research Datasets

ArxivRollBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Language Model Evaluation

ArxivRollBench 2026a

70.8Valid Accuracy

42

Research Paper Reasoning and Comprehension

ArxivRollBench 2025a (val)

44.3Valid Accuracy

38

Biased overtraining evaluation

ArxivRollBench

0.22RSII

14

Contamination Evaluation

ArxivRollBench

0.48Absolute RS_I

14

Popular tasks

Language Model Evaluation Research Paper Reasoning and Comprehension Contamination Evaluation Biased overtraining evaluation

Follow for updates

Join SOTA2 Contact