Discrete (Queen) Task on AMAZE
16.07ViolationJanus-Pro
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Janus-ProCoT=false, Fine-tuned=true2026.04 | 16.07 | 83.93 | 7.91 | 1.38 | 12.57 | 13.03 | |
| Janus-ProCoT=true, Fine-tuned=true2026.04 | 18.52 | 81.48 | 6.48 | 1.67 | 11.2 | 13.56 | |
| NanoBanana-ProCoT=false2026.04 | 32.56 | 67.43 | 9.1 | 1.62 | 30.35 | 35.58 | |
| BagelCoT=false, Fine-tuned=false2026.04 | 61.57 | 38.43 | 8.94 | 1.22 | 0 | 0 | |
| GPT-image-1CoT=false2026.04 | 62.91 | 37.09 | 11.84 | 5.87 | 0 | 2.28 | |
| BagelCoT=true, Fine-tuned=true2026.04 | 64.22 | 35.78 | 6.13 | 0.72 | 14.08 | 14.11 | |
| BagelCoT=false, Fine-tuned=true2026.04 | 68.27 | 31.73 | 6.05 | 0.63 | 14.57 | 14.29 | |
| Qwen-Image-EditCoT=false2026.04 | 69.52 | 30.47 | 8.83 | 5.3 | 2.86 | 4 | |
| Seedream-4.5CoT=false2026.04 | 76.86 | 23.14 | 11.55 | 5.95 | 2.86 | 2.86 | |
| Flux-Kontext-DevCoT=false2026.04 | 78.63 | 21.37 | 11.48 | 7.71 | 0.92 | 2.34 | |
| Janus-ProCoT=true, Fine-tuned=false2026.04 | 82.91 | 17.09 | 10.93 | 8.04 | 0 | 0.7 | |
| Janus-ProCoT=false, Fine-tuned=false2026.04 | 84.24 | 15.76 | 12.97 | 9.83 | 0 | 0.57 | |
| BagelCoT=true, Fine-tuned=false2026.04 | 98.41 | 1.59 | 9.63 | 1.4 | 0 | 0 |