Long-form Text Generation on LongWriter
93.5AccuracyQwen3-8B-WRL
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen3-8B-WRLbackbone=Qwen3-8B, alignment_strategy=WRL2026.04 | 93.5 | 95.6 | 91.3 | 89.8 | 81.9 | 85.4 | 89.6 | |
| Qwen3-8Bbackbone=Qwen3-8B2026.04 | 93.3 | 96.2 | 90.2 | 89.6 | 79.2 | 86.3 | 89.1 | |
| Distill-Qwen-14Bbackbone=Qwen-14B2026.04 | 92.9 | 97.1 | 94.4 | 92.1 | 70 | 84 | 88.4 | |
| Distill-Qwen-14B-WRLbackbone=Qwen-14B, alignment_strategy=WRL2026.04 | 91.9 | 97.5 | 92.7 | 90.6 | 76.3 | 85.2 | 89 | |
| LongWriter-glm4-9Bbackbone=GLM-4-9B2026.04 | 90 | 95 | 91.7 | 88.5 | 73.3 | 83.5 | 87 | |
| Qwen2.5-7B-Instruct-WRLbackbone=Qwen2.5-7B, alignment_strategy=WRL2026.04 | 90 | 92.9 | 82.7 | 82.9 | 72.3 | 76.5 | 82.9 | |
| Qwen2.5-7B-Instructbackbone=Qwen2.5-7B2026.04 | 89.6 | 91.7 | 80.8 | 80.6 | 67.7 | 74.6 | 80.8 | |
| LongWriter-llama3.1-8Bbackbone=Llama-3.1-8B2026.04 | 88.3 | 91.5 | 86 | 85.6 | 66.7 | 76.5 | 82.4 | |
| Llama-3.1-8B-Instruct-WRLbackbone=Llama-3.1-8B, alignment_strategy=WRL2026.04 | 84 | 92.3 | 81.9 | 79.8 | 55.2 | 69.8 | 77.2 | |
| Llama-3.1-8B-Instructbackbone=Llama-3.1-8B2026.04 | 81.9 | 89.8 | 80.6 | 79.2 | 53.3 | 66.9 | 75.3 | |
| Qwen2.5-1.5B-Instruct-WRLbackbone=Qwen2.5-1.5B, alignment_strategy=WRL2026.04 | 77.7 | 76.9 | 70.2 | 70 | 50.4 | 57.5 | 67.1 | |
| Qwen2.5-1.5B-Instructbackbone=Qwen2.5-1.5B2026.04 | 71 | 68.5 | 65.2 | 65 | 42.1 | 55 | 61.1 | |
| H2OBackbone=Llama-8B, KV Cache Budget=5%2025.10 | 68.1 | — | — | — | — | — | — | |
| ThinKVBackbone=Llama-8B, KV Cache Budget=3.75%2025.10 | 67.9 | — | — | — | — | — | — | |
| FullKVBackbone=Llama-8B2025.10 | 66.5 | — | — | — | — | — | — | |
| ThinKVBackbone=Phi-14B, KV Cache Budget=3.75%2025.10 | 63.8 | — | — | — | — | — | — | |
| FullKVBackbone=Phi-14B2025.10 | 62.9 | — | — | — | — | — | — | |
| H2OBackbone=Phi-14B, KV Cache Budget=5%2025.10 | 61.5 | — | — | — | — | — | — |