Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Consistency Evaluation research benchmarks · SOTA2 Research

Consistency Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0.29CR Mean

9

Feb 26, 2026

Diagnostic (Avg. YouCook2, COIN, CrossTask) (test)

76.92State Accuracy

8

Mar 10, 2026

0.32MC Score

4

May 19, 2026

90.26CLIP Score

4

May 19, 2026

Consistency Evaluation Dataset (N=720) 1.0 (test)

—

—Primary metric

0

Feb 26, 2026

Popular datasets

diagnostic Consistency Evaluation Dataset DecisionBench RealUnify Unified-Bench

Follow for updates

Join SOTA2 Contact