Clevr
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CLEVR 1 (test)
15.6FID
3
CLEVR 1 (test)
43.4PSNR
3
CLEVR-567 (test)
0.021LPIPS
3
packed-CLEVR-11 (test)
0.832ARI
3
CLEVR-SV (test)
37Win Rate
3
CLEVR-CoGenT (in-distribution)
98Accuracy
3
CLEVR 256x256 (train)
0.89FID
3
CLEVR Change (Distractor)
63.7BLEU-4
3
CLEVR Change Scene
52.1BLEU-4
3
CLEVR-M
81.7Accuracy
2
CLEVR-Count
57.5Accuracy
2
CLEVR-SYN medium (val)
81.2Accuracy
2
Clevr (test)
46Semantic Retrieval Latency (s)
2
Clevr (test)
3.13Runtime (seconds)
2
CLEVR
71.2CLEVR Dist Error
2
CLEVR
86.8Count Accuracy
2
CLEVR Packed (16+ objects)
96.8Human Preference Score
2
CLEVR6 (test)
46.8Shape Acc
1
CLEVR-CoGenT syst. generalization
—Accuracy
0
CLEVR (sample)
—Disentanglement
0
CLEVR (test)
—FID
0
CLEVR (test)
—FID
0