Clevr
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CLEVR (test)
100Accuracy
4
CLEVR (train)
100Accuracy
4
Clevr-4 full-shot
66.5Texture Accuracy
4
CLEVR 1.0 (val)
99.7Accuracy
4
CLEVR 567 unseen appearance uORF-variant (test)
85.5ARI
4
CLEVR 567
86.3ARI
4
CLEVR (test)
16.22FID
4
CLEVR (test)
95.7Shape Acc
4
CLEVR (test)
67.42mBO
4
CLEVR-Ref
100Accuracy
4
CLEVR6 (val)
63.6mIoU
4
CLEVR6 (test)
0.988ARI
4
CLEVR
0.068Object Area Score
4
CLEVR (test)
0.768Disentanglement
4
Clevr-4 Average
99Accuracy (All)
4
Clevr-4 (Count)
0.968Accuracy (All)
4
Clevr-4 Color
1ACC (All)
4
Clevr-4 (Shape)
1Accuracy (All)
4
Clevr-4 (Texture)
99.1Accuracy (All)
4
CLEVR Synergy synthetic (val)
63.08Accuracy
3
CLEVR
68.5Normalized Binding Information Beta
3
CLEVR-DS-L (test)
16.33Recall@1
3
CLEVR-DS-S (test)
14.66Recall@1
3
CLEVR CoGenT (Split B)
78.8Accuracy
3
VL-ICL CLEVR
30Avg Accuracy (1-2 ICL)
3