Story Generation Quality on 180 prompts Aggregate (held-out)
72.4Story Quality ScoreGPT-5.4
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5.4P=-2026.06 | 72.4 | |
| HumanP=-2026.06 | 68.7 | |
| Claude Opus 4.6P=-2026.06 | 61.8 | |
| Gemini 3.1 ProP=-2026.06 | 57.5 | |
| POLARISP=9B2026.06 | 52.1 | |
| Gemma 4 31BP=31B2026.06 | 51.4 | |
| Gemma 4 26B-A4BNote=MoE, 4B active2026.06 | 51.3 | |
| Gemini 3 FlashP=-2026.06 | 48.5 | |
| Qwen3.5-27BP=27B2026.06 | 42.8 | |
| Gemma 4 E4BNote=8B total, 4.5B effective2026.06 | 36.1 | |
| LW-Zero-32BP=32B2026.06 | 27.1 | |
| Ministral-3-8BP=8B2026.06 | 26.1 | |
| Qwen3.5-9BP=9B2026.06 | 18.5 | |
| LW-Llama-8BP=8B2026.06 | 2 | |
| DeepSeek-R1-Distill-Qwen-14BP=14B2026.06 | 0.2 |