Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

ArcBench dataset and benchmarks · SOTA2 Research

Research Datasets

ArcBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

VLM Pairwise Preference

ArcBench

100Win Rate

54

VLM-as-Judge Evaluation

ArcBench VLM-as-Judge Closed

58.5TQ

15

VLM-as-Judge Evaluation

ArcBench VLM-as-Judge Open

86.11TQ

15

VLM-based Q/A Quiz

ArcBench VLM-based Q/A Quiz Closed

97.6Story Accuracy

15

VLM-based Q/A Quiz

ArcBench VLM-based Q/A Quiz Open

95.69Accuracy (Story)

15

Popular tasks

VLM-based Q/A Quiz VLM-as-Judge Evaluation VLM Pairwise Preference

Follow for updates

Join SOTA2 Contact