Academic Illustration Generation on PaperBananaBench
50FaithfulnessHuman
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HumanFramework Type=Human Evaluation Reference2026.01 | 50 | 50 | 50 | 50 | 50 | |
| PaperBananaFramework Type=Agentic Frameworks, Image Generation Model=Nano-Banana-Pro2026.01 | 45.8 | 80.7 | 51.4 | 72.1 | 60.2 | |
| Nano-Banana-ProFramework Type=Vanilla Settings, Image Generation Model=Nano-Banana-Pro2026.01 | 43 | 43.5 | 38.5 | 65.5 | 43.2 | |
| Few-shot Nano-Banana-ProFramework Type=Vanilla Settings, Image Generation Model=Nano-Banana-Pro, Prompting Strategy=Few-shot2026.01 | 41.6 | 49.6 | 37.6 | 60.5 | 41.8 | |
| CRAFTERBackbone=Nano Banana 2, Type=Agentic framework2026.05 | 38.18 | 53.42 | 47.77 | 64.21 | 50.34 | |
| CRAFTERBackbone=Nano Banana Pro, Type=Agentic framework2026.05 | 37.72 | 55.31 | 48.46 | 65.29 | 50 | |
| PaperBananaBackbone=Nano Banana Pro, Type=Agentic framework2026.05 | 31.34 | 52.74 | 45.03 | 61.3 | 35.96 | |
| PaperBananaBackbone=Nano Banana 2, Type=Agentic framework2026.05 | 28.1 | 52.41 | 42.64 | 61.68 | 33.73 | |
| Nano Banana ProModel Source=Closed-source, Type=Standalone generator2026.05 | 25.43 | 36.13 | 37.16 | 50.52 | 22.43 | |
| PaperBananaFramework Type=Agentic Frameworks, Image Generation Model=GPT-Image-1.52026.01 | 16 | 65 | 33 | 56 | 19 | |
| Nano Banana 2Model Source=Closed-source, Type=Standalone generator2026.05 | 15.07 | 11.99 | 26.88 | 47.95 | 11.13 | |
| AutoFigureBackbone=Nano Banana 2, Type=Agentic framework2026.05 | 12.33 | 6.85 | 3.26 | 7.71 | 1.37 | |
| GPT-Image-2*Model Source=Closed-source, Type=Standalone generator2026.05 | 8.42 | 3.97 | 1.72 | 40.72 | 1.37 | |
| Paper2AnyFramework Type=Agentic Frameworks, Image Generation Model=Nano-Banana-Pro2026.01 | 6.5 | 44 | 20.5 | 40 | 8.5 | |
| GPT-Image-1.5Framework Type=Vanilla Settings, Image Generation Model=GPT-Image-1.52026.01 | 4.5 | 37.5 | 30 | 37 | 11.5 | |
| GLM-ImageModel Source=Open-source, Type=Standalone generator2026.05 | 0 | 0.69 | 0 | 1.55 | 0 | |
| Qwen-ImageModel Source=Open-source, Type=Standalone generator2026.05 | 0 | 0 | 0 | 1.71 | 0 |