Reasoning Generation on WISE 1.0 (test)
80Overall ScoreGPT-4o
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-4o2025.12 | 80 | 81 | 71 | 89 | 83 | 79 | 74 | |
| ThinkGenCoT reasoning=true2025.12 | 76 | 78 | 73 | 85 | 74 | 74 | 68 | |
| BAGELCategory=Und. and Gen., CoT reasoning=true2025.12 | 70 | 76 | 69 | 75 | 65 | 75 | 58 | |
| STARCategory=Und. and Gen.2025.12 | 66 | 61 | 67 | 61 | 74 | 69 | 66 | |
| BLIP3-o-8BCategory=Und. and Gen.2025.12 | 62 | — | — | — | — | — | — | |
| MetaQuery-XLCategory=Und. and Gen.2025.12 | 55 | 56 | 55 | 62 | 49 | 63 | 41 | |
| ThinkGenCoT reasoning=false2025.12 | 55 | 53 | 55 | 71 | 51 | 58 | 40 | |
| BAGELCategory=Und. and Gen., CoT reasoning=false2025.12 | 52 | 44 | 55 | 68 | 44 | 60 | 39 | |
| FLUX.1-devCategory=Gen. Only2025.12 | 50 | 48 | 58 | 62 | 42 | 51 | 35 | |
| PixArt-αCategory=Gen. Only2025.12 | 47 | 45 | 50 | 48 | 49 | 56 | 34 | |
| OmniGen2Category=Und. and Gen.2025.12 | 47 | 42 | 52 | 64 | 43 | 50 | 34 | |
| SD-3.5-largeCategory=Gen. Only2025.12 | 46 | 44 | 50 | 58 | 44 | 52 | 31 | |
| SDXLCategory=Gen. Only2025.12 | 43 | 43 | 48 | 47 | 44 | 45 | 27 | |
| Emu3Category=Und. and Gen.2025.12 | 39 | 34 | 45 | 48 | 41 | 45 | 27 | |
| Janus-Pro-7BCategory=Und. and Gen.2025.12 | 35 | 30 | 37 | 49 | 36 | 42 | 26 | |
| Show-oCategory=Und. and Gen.2025.12 | 35 | 28 | 40 | 48 | 30 | 46 | 30 | |
| VILA-UCategory=Und. and Gen.2025.12 | 31 | 26 | 33 | 37 | 35 | 39 | 23 |