Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Compositional Generalization research benchmarks · SOTA2 Research

Compositional Generalization

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Evaluation Dataset (Unseen Average)

42.86Score

18

Feb 26, 2026

Evaluation Dataset Seen Average

62.34Score

18

Feb 26, 2026

Evaluation Dataset Unseen (Fold 3)

0.402Score

18

Feb 26, 2026

Evaluation Dataset (Fold 3 Seen)

LLaMA-3-8B + COGLM

66.69Score

18

Feb 26, 2026

Evaluation Dataset Unseen (Fold 2)

50Score

18

Feb 26, 2026

Evaluation Dataset (Fold 2 Seen)

Gemma-7B + COGLM

63.63Score

18

Feb 26, 2026

Evaluation Dataset Unseen (Fold 1)

0.482Score

18

Feb 26, 2026

Evaluation Dataset (Fold 1 Seen)

0.619Score

18

Feb 26, 2026

Evaluation Dataset (Full)

Gemma-7B + COGLM

0.638Score

18

Feb 26, 2026

83.9Exact Match Accuracy

6

May 7, 2026

23.44Length

6

May 7, 2026

49P1 Score

6

Mar 11, 2026

100P1

6

Mar 11, 2026

ColorMNIST 40 OOD compositions (Generalization)

84.7FID

5

May 11, 2026

ColorMNIST Faithfulness 40 OOD compositions

62.6FID

5

May 11, 2026

Popular datasets

Evaluation dataset ColorMNIST COGS SCAN Logistics

Follow for updates

Join SOTA2 Contact