List your company

ResearchFormerly WizWand

Clevr

Benchmarks

TaskDatasetSOTA resultTrendResults

Concept Attribution

CLEVR (test)

0.85F1 Score

160

Visual Question Answering

CLEVR (test)

99.8Overall Accuracy

61

Visual Question Answering

CLEVR 1.0 (test)

99.6Overall Accuracy

46

Object Hallucination Detection

CLEVR

77.72AUROC

35

Criteria-conditioned Clustering

Clevr-4c OpenSMC

84.7Clustering Accuracy (CAcc)

30

Conditional Image Generation

CLEVR

98Accuracy

25

Visual Question Answering

Super-CLEVR (test)

87.4Accuracy

24

Visual Question Answering

CLEVR Style-transferred Target

95.9Accuracy

24

Image Classification

CLEVR

76.2Accuracy

22

Visual Question Answering

CLEVR-Humans 1.0 (test)

85.5Accuracy

22

Visual Question Answering

CLEVR (val)

100Overall Accuracy

21

Concept Attribution

CLEVR

51Avg Attribution F1

18

Customized few-shot classification

Clevr 4 10k

98.69Shape Accuracy

18

Unsupervised Object Segmentation

CLEVR 1.0 (test)

95.94FG-ARI

16

Image Classification

CLEVR (test)

45.4Accuracy

14

Visual Reasoning

CLEVR VL-ICL Bench

38.9Average Accuracy

14

Shifted rightmost object color inference

CLEVR

62.06Accuracy (Shifted Rightmost Color)

13

Third object from right color inference

CLEVR

41.95Accuracy

13

Rightmost object material inference

CLEVR

86.84Accuracy

13

Rightmost object shape inference

CLEVR

70.03Accuracy

13

Rightmost object size inference

CLEVR

93.22Accuracy

13

Bottommost object color inference (BC)

CLEVR

84.09BC Accuracy

13

Leftmost object color inference (LC)

CLEVR

81.79Accuracy

13

Rightmost object color inference (RC)

CLEVR

98.75Accuracy

13

Image Generation

CLEVR

0.81FID

13