Clevr
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CLEVR (test)
0.85F1 Score
160
CLEVR (test)
99.8Overall Accuracy
61
CLEVR 1.0 (test)
99.6Overall Accuracy
46
CLEVR
77.72AUROC
35
Clevr-4c OpenSMC
84.7Clustering Accuracy (CAcc)
30
CLEVR
98Accuracy
25
Super-CLEVR (test)
87.4Accuracy
24
CLEVR Style-transferred Target
95.9Accuracy
24
CLEVR
76.2Accuracy
22
CLEVR-Humans 1.0 (test)
85.5Accuracy
22
CLEVR (val)
100Overall Accuracy
21
CLEVR
51Avg Attribution F1
18
Clevr 4 10k
98.69Shape Accuracy
18
CLEVR 1.0 (test)
95.94FG-ARI
16
CLEVR (test)
45.4Accuracy
14
CLEVR VL-ICL Bench
38.9Average Accuracy
14
CLEVR
62.06Accuracy (Shifted Rightmost Color)
13
CLEVR
41.95Accuracy
13
CLEVR
86.84Accuracy
13
CLEVR
70.03Accuracy
13
CLEVR
93.22Accuracy
13
CLEVR
84.09BC Accuracy
13
CLEVR
81.79Accuracy
13
CLEVR
98.75Accuracy
13
CLEVR
0.81FID
13