T2I-CompBench
Benchmarks
TaskDatasetSOTA resultTrendResults
T2I-CompBench
73.66Shape Fidelity
185
T2I-CompBench++
0.868Color
99
T2I-CompBench (test)
91Color Accuracy
86
T2I-CompBench
84.47Color Fidelity
58
T2I-CompBench++ v2 (test)
86.97Color
37
T2I-CompBench
0.463T2I-CompBench Score
27
T2I-CompBench++
87.03BLIP-VQA Color Score
21
T2I-CompBench
83.8Color Fidelity
16
T2I-CompBench
0.794Color Accuracy
16
T2I-CompBench
75B-VQA Score
16
T2I-CompBench Single Category
1.23Counting MAE
15
T2I-CompBench 1.0 (test)
0.344CLIP Score
14
T2I-CompBench standard
88.613D Spatial Score
13
T2I-CompBench
77.07Color Fidelity
13
T2I-CompBench v1.0 (test)
86.92Color Score
13
T2I-CompBench++ v1.0 (test)
73.23Color Score (B-VQA)
12
T2I-CompBench
5Evaluation Time (min)
12
T2I-CompBench
87.23Color Score
11
T2I-CompBench (test)
78.59Color Accuracy
11
T2I-CompBench++
39Color Score
10
T2I-CompBench
84.2Color Score
10
T2I-CompBench
85.42Color Score
9
T2I-CompBench
77.68Color Fidelity Score
9
T2I-CompBench
75.68Color Fidelity
9
T2I-Compbench
0.506T2I-Compbench Alignment
9