Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CREPE dataset and benchmarks · SOTA2 Research

Research Datasets

CREPE

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Compositional Reasoning

CREPE

44.9Accuracy

21

Compositionality Evaluation

CREPE

92.6CU

14

Image-to-Text retrieval

CREPE (test)

0.874Multi-Obj Acc

13

Image-to-text retrieval

CREPE productivity

17.9R@1 (replace)

8

Image-to-text retrieval

CREPE systematicity CC12M

36.6R@1 (atom)

8

Text-image retrieval

CREPE

73.56NDCG@10

6

Compositional Evaluation

CREPE productivity (test)

0.14Replace Rate

4

Compositional Evaluation

CREPE systematicity (test)

34Atom Score

4

Popular tasks

Image-to-Text Retrieval Compositional Evaluation Text-Image Retrieval Compositional Reasoning Compositionality Evaluation

Follow for updates

Join SOTA2 Contact