List your company

ResearchFormerly WizWand

CREPE

Benchmarks

TaskDatasetSOTA resultTrendResults

Compositional Reasoning

CREPE

44.9Accuracy

21

Compositionality Evaluation

CREPE

92.6CU

14

Image-to-Text retrieval

CREPE (test)

0.874Multi-Obj Acc

13

Image-to-text retrieval

CREPE productivity

17.9R@1 (replace)

8

Image-to-text retrieval

CREPE systematicity CC12M

36.6R@1 (atom)

8

Text-image retrieval

CREPE

73.56NDCG@10

6

Compositional Evaluation

CREPE productivity (test)

0.14Replace Rate

4

Compositional Evaluation

CREPE systematicity (test)

34Atom Score

4