Text-to-Image Generation on T2I-CompBench
5Evaluation Time (min)Evaluation Agent
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Evaluation AgentTarget Model=SD1.4, Scope=Avg. Cost per Dimension2024.12 | 5 | 26 | |
| Evaluation AgentTarget Model=SD2.1, Scope=Avg. Cost per Dimension2024.12 | 6 | 26 | |
| Evaluation AgentTarget Model=SD3.0, Scope=Avg. Cost per Dimension2024.12 | 7 | 25 | |
| Evaluation AgentTarget Model=SDXL, Scope=Avg. Cost per Dimension2024.12 | 8 | 26 | |
| T2I-Comp (Original Pipeline)Target Model=SD1.4, Scope=Avg. Cost per Dimension2024.12 | 141 | 3,000 | |
| T2I-Comp (Original Pipeline)Target Model=SD2.1, Scope=Avg. Cost per Dimension2024.12 | 196 | 3,000 | |
| T2I-Comp (Original Pipeline)Target Model=SD3.0, Scope=Avg. Cost per Dimension2024.12 | 353 | 3,000 | |
| T2I-Comp (Original Pipeline)Target Model=SDXL, Scope=Avg. Cost per Dimension2024.12 | 386 | 3,000 | |
| T2I-Comp (Original Pipeline)Target Model=SD1.4, Scope=Total Cost2024.12 | 563 | 12,000 | |
| T2I-Comp (Original Pipeline)Target Model=SD2.1, Scope=Total Cost2024.12 | 782 | 12,000 | |
| T2I-Comp (Original Pipeline)Target Model=SD3.0, Scope=Total Cost2024.12 | 1,410 | 12,000 | |
| T2I-Comp (Original Pipeline)Target Model=SDXL, Scope=Total Cost2024.12 | 1,543 | 12,000 |