Text-to-Image Generation on IntraCompBench
99Multi-Class AccuracyQwen-Image + ISACLS
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen-Image + ISACLSLatency=210s, VRAM=65.3GB2025.05 | 99 | 99 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flux.2-dev + ISACLSLatency=305s, VRAM=79.8GB2025.05 | 99 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flux.1-dev + ISACLSLatency=85s, VRAM=40.8GB2025.05 | 97 | 99 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flux.2-devLatency=205s, VRAM=74.2GB2025.05 | 97 | 100 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen-ImageLatency=140s, VRAM=60.1GB2025.05 | 91 | 98 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Flux.1-devLatency=50s, VRAM=37.2GB2025.05 | 84 | 97 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ISAC_LOBase Model=SD3.5-M2025.05 | 52 | 83 | 140 | 74.8 | — | — | — | — | — | — | — | — | — | — | |
| ISAC_LOBase Model=SD1.52025.05 | 36 | 69 | 21 | 9.7 | — | — | — | — | — | — | — | — | — | — | |
| DeLeakerBase Model=SD3.5-M2025.05 | 30 | 62 | 60 | 32 | — | — | — | — | — | — | — | — | — | — | |
| SD3.5-MBase Model=SD3.5-M2025.05 | 25 | 64 | 40 | 22.9 | — | — | — | — | — | — | — | — | — | — | |
| CO3Base Model=SD1.52025.05 | 18 | 55 | 23 | 6 | — | — | — | — | — | — | — | — | — | — | |
| SD1.5Base Model=SD1.52025.05 | 8 | 54 | 8 | 4.9 | — | — | — | — | — | — | — | — | — | — | |
| Flux.2-klein-4BLatency=4s, VRAM=29GB2025.05 | — | — | — | — | 79 | 45 | 12 | 1 | 34 | 98 | 81 | 75 | 49 | 75 | |
| Flux.2-klein-4B + ISACLOLatency=8s, VRAM=64GB2025.05 | — | — | — | — | 89 | 63 | 43 | 19 | 54 | 100 | 93 | 86 | 65 | 86 | |
| Z-Image-TurboLatency=6s, VRAM=33GB2025.05 | — | — | — | — | 67 | 58 | 38 | 32 | 48 | 100 | 92 | 45 | 37 | 68 | |
| Z-Image-Turbo + ISACLOLatency=13s, VRAM=78GB2025.05 | — | — | — | — | 87 | 74 | 61 | 49 | 68 | 100 | 97 | 62 | 49 | 77 |