Writing on WritingBench v1 (test)
85.3Average Scoreo3-2025-04-16
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| o3-2025-04-16Access=Proprietary2026.04 | 85.3 | — | — | 84.8 | 85.2 | 83.9 | 85.9 | 85.8 | 86.8 | 85.1 | 87.5 | 85.2 | 91 | 86.3 | 87.2 | |
| O3-2025-04-16Model Category=Proprietary2026.04 | 85.27 | — | — | 84.81 | 85.2 | 83.89 | 85.88 | 85.82 | 86.8 | 85.14 | 87.45 | 85.24 | 90.98 | 86.31 | 87.21 | |
| DeepSeek-R1-0528Model Category=Open-source2026.04 | 83.22 | — | — | 83.15 | 81.48 | 81.55 | 85.68 | 84.14 | 84.44 | 84.24 | 87.27 | 83.72 | 89.35 | 83.83 | 82.7 | |
| DeepSeek-R1-0528Access=Open-source2026.04 | 83.2 | — | — | 83.2 | 81.5 | 81.6 | 85.7 | 84.1 | 84.4 | 84.2 | 87.3 | 83.7 | 89.4 | 83.8 | 82.7 | |
| Gemini-2.5-pro-previewAccess=Proprietary2026.04 | 83.1 | — | — | 83.2 | 81.5 | 83 | 84.5 | 84.5 | 82.1 | 83.6 | 86.5 | 83.9 | 90.5 | 83.4 | 84 | |
| Gemini-2.5-pro-previewModel Category=Proprietary2026.04 | 83.05 | — | — | 83.21 | 81.47 | 83 | 84.52 | 84.49 | 82.14 | 83.58 | 86.49 | 83.86 | 90.45 | 83.35 | 83.98 | |
| Qwen3-8B-Thinking + RLMethod=ACPO, Thinking=true, RL=true2026.04 | 82.42 | — | — | 83.17 | 81.85 | 83.05 | 80.8 | 83.57 | 82.72 | 82.68 | 85.32 | 82.68 | 87.61 | 81.6 | 80.62 | |
| Qwen3-235B-A22B-thinkingAccess=Open-source2026.04 | 81.5 | — | — | 80.2 | 79.2 | 81 | 82.9 | 82.5 | 82.9 | 82.5 | 85 | 81.3 | 88.2 | 81.3 | 81.8 | |
| Qwen3-235B-A22B-ThinkingModel Category=Open-source, Thinking=true2026.04 | 81.45 | — | — | 80.19 | 79.24 | 80.95 | 82.92 | 82.52 | 82.89 | 82.54 | 85.02 | 81.3 | 88.22 | 81.26 | 81.76 | |
| LongWriter-Zero-32BModel Category=Open-source2026.04 | 80.3 | — | — | 80.66 | 80.27 | 80.21 | 76.09 | 83.55 | 81.02 | 79.89 | 83.38 | 80.77 | 86.82 | 80.23 | 82.05 | |
| LongWriter-Zero-32BAccess=Open-source2026.04 | 80.3 | — | — | 80.7 | 80.3 | 80.2 | 76.1 | 83.6 | 81 | 79.9 | 83.4 | 80.8 | 86.8 | 80.2 | 82.1 | |
| Claude-3-7-sonnetAccess=Proprietary2026.04 | 78.5 | — | — | 78.2 | 77.9 | 76.5 | 79.4 | 79.3 | 80.9 | 79.4 | 82.5 | 78.8 | 86.1 | 79.2 | 80.5 | |
| Claude-Sonnet-3.7Model Category=Proprietary2026.04 | 78.48 | — | — | 78.24 | 77.93 | 76.51 | 79.37 | 79.26 | 80.88 | 79.43 | 82.51 | 78.84 | 86.14 | 79.23 | 80.49 | |
| Qwen3-4B-Thinking + RLMethod=ACPO, Thinking=true, RL=true2026.04 | 77.36 | — | — | 78.63 | 78.48 | 77.88 | 72.61 | 79.55 | 77.91 | 77.83 | 82.01 | 78.2 | 85.62 | 76.71 | 77.92 | |
| Qwen3-8B-ThinkingModel Category=Our Models (Baseline), Thinking=true2026.04 | 77.11 | — | — | 77.54 | 77.73 | 77.63 | 73.68 | 78.49 | 78.42 | 77.62 | 81.79 | 77.74 | 83.6 | 76.58 | 76.86 | |
| Qwen3-8B w/ WRLStrategy=WRL (Fine-grained Reward Modeling)2026.04 | 76.2 | — | — | 76.3 | 74.6 | 76.5 | 75.2 | 78.3 | 78 | 77.6 | 80.7 | 76.9 | 86.6 | 77 | 81.3 | |
| Qwen3-8B-ThinkingModel Category=Open-source, Thinking=true2026.04 | 75.56 | — | — | 75.47 | 74.42 | 75.51 | 73.03 | 77.8 | 77.16 | 76.29 | 79.72 | 75.67 | 84.96 | 74.35 | 77.3 | |
| GPT-4oAccess=Proprietary2026.04 | 75.5 | — | — | 74.4 | 73.4 | 74.4 | 77.9 | 75.9 | 78.1 | 76.8 | 81.6 | 75.8 | 85.5 | 76.1 | 76.7 | |
| GPT-4oModel Category=Proprietary2026.04 | 75.46 | — | — | 74.4 | 73.42 | 74.38 | 77.91 | 75.86 | 78.08 | 76.82 | 81.57 | 75.82 | 85.46 | 76.13 | 76.73 | |
| Qwen3-8BAccess=Capability-enhanced2026.04 | 74.9 | — | — | 74.9 | 73.9 | 75 | 73.5 | 76.8 | 76.5 | 75.6 | 80.1 | 75.7 | 84.8 | 74.6 | 78.1 | |
| Qwen3-1.7B-Thinking + RLMethod=ACPO, Thinking=true, RL=true2026.04 | 73.65 | — | — | 76.06 | 74.54 | 74.03 | 68.54 | 75.14 | 74.5 | 74.71 | 78.8 | 74.43 | 81.59 | 73.31 | 73.67 | |
| Qwen3-235B-A22BModel Category=Open-source2026.04 | 73.63 | — | — | 73.56 | 72.9 | 73.98 | 70.13 | 76.52 | 74.69 | 77.46 | 82.05 | 77.01 | 87.29 | 76.26 | 79.57 | |
| Qwen3-235B-A22BAccess=Open-source2026.04 | 73.6 | — | — | 73.6 | 72.9 | 74 | 70.1 | 76.5 | 74.7 | 77.5 | 82.1 | 77 | 87.3 | 76.3 | 79.6 | |
| Qwen3-4B-ThinkingModel Category=Our Models (Baseline), Thinking=true2026.04 | 71.35 | — | — | 72.57 | 73.1 | 72.06 | 64.38 | 74.54 | 72.95 | 72.08 | 76.79 | 72.17 | 79.18 | 70.51 | 70.93 | |
| Qwen3-8BModel Category=Open-source2026.04 | 70.75 | — | — | 70.68 | 70.74 | 70.33 | 68.51 | 72.74 | 71.52 | 71.72 | 76.77 | 71.69 | 83.12 | 70.06 | 75.36 | |
| o1-PreviewAccess=Proprietary2026.04 | 68.6 | — | — | 68.5 | 67 | 66.6 | 69.5 | 70.3 | 71.4 | 70.1 | 75.1 | 68.5 | 79.8 | 70.9 | 73.8 | |
| o1-PreviewModel Category=Proprietary2026.04 | 68.57 | — | — | 68.54 | 67.01 | 66.57 | 69.53 | 70.31 | 71.41 | 70.09 | 75.1 | 68.49 | 79.78 | 70.91 | 73.81 | |
| Distill-Qwen-14B w/ WRLStrategy=WRL (Fine-grained Reward Modeling)2026.04 | 66.7 | — | — | 67.2 | 64.8 | 67.2 | 64.3 | 69 | 69.8 | 68.3 | 72.7 | 67.8 | 80.8 | 67.5 | 71 | |
| Qwen2.5-72B-instructAccess=Open-source2026.04 | 65.3 | — | — | 65.8 | 63.4 | 63.8 | 62.8 | 68.1 | 67.9 | 65.8 | 70.5 | 65.9 | 78.7 | 66.4 | 68 | |
| Qwen-2.5-72B-instructModel Category=Open-source, Type=Instruct2026.04 | 65.28 | — | — | 65.8 | 63.36 | 63.8 | 62.75 | 68.07 | 67.91 | 65.81 | 70.49 | 65.92 | 78.65 | 66.38 | 67.95 | |
| Qwen2.5-7B-Instruct w/ WRLStrategy=WRL (Fine-grained Reward Modeling)2026.04 | 64.4 | — | — | 66.6 | 63.7 | 64.9 | 59 | 69.1 | 65.7 | 65.1 | 68.6 | 65.8 | 78.3 | 64.8 | 67.3 | |
| Qwen3-1.7B-ThinkingModel Category=Our Models (Baseline), Thinking=true2026.04 | 63.06 | — | — | 66.72 | 64.41 | 64.13 | 58.13 | 60.52 | 63.67 | 64.92 | 70.02 | 62.96 | 70.43 | 61.16 | 60.53 | |
| LongWriter-glm-9BModel Category=Open-source2026.04 | 62.94 | — | — | 64.06 | 63.66 | 62.35 | 61.26 | 65.03 | 61.3 | 62.79 | 66.7 | 63.6 | 74.82 | 63.37 | 65.88 | |
| LongWriter-glm4-9BAccess=Open-source2026.04 | 62.9 | — | — | 64.1 | 63.7 | 62.4 | 61.3 | 65 | 61.3 | 62.8 | 66.7 | 63.6 | 74.8 | 63.4 | 65.9 | |
| Distill-Qwen-14BAccess=Capability-enhanced2026.04 | 60.7 | — | — | 60 | 59.7 | 61.7 | 58 | 62.5 | 63.9 | 62.1 | 67.4 | 61.7 | 73.1 | 60.7 | 61.2 | |
| LongWriter-llama3.1-8BModel Category=Open-source2026.04 | 58.01 | — | — | 60.05 | 59.31 | 57.58 | 56.03 | 58.38 | 56.73 | 58.12 | 61.4 | 58.6 | 67.61 | 59.05 | 62.97 | |
| LongWriter-llama3.1-8BAccess=Open-source2026.04 | 58 | — | — | 60.1 | 59.3 | 57.6 | 56 | 58.4 | 56.7 | 58.1 | 61.4 | 58.6 | 67.6 | 59.1 | 63 | |
| Qwen2.5-7B-InstructAccess=Capability-enhanced2026.04 | 57 | — | — | 58.6 | 55.9 | 55.3 | 53 | 59.5 | 60.1 | 57.4 | 62.3 | 57.7 | 70.2 | 56.6 | 55.6 | |
| Llama-3.3-70B-instructModel Category=Open-source, Type=Instruct2026.04 | 50.43 | — | — | 50.67 | 49.25 | 47.9 | 48.52 | 52.92 | 56.56 | 50.71 | 50.71 | 50.38 | 50.38 | 51.08 | 51.08 | |
| Llama-3.3-70B-instructAccess=Open-source2026.04 | 50.4 | — | — | 50.7 | 49.3 | 47.9 | 48.5 | 52.9 | 56.6 | 50.7 | 50.7 | 50.4 | 50.4 | 51.1 | 51.1 | |
| Qwen2.5-1.5B-Instruct w/ WRLStrategy=WRL (Fine-grained Reward Modeling)2026.04 | 50.1 | — | — | 53.5 | 51.7 | 50.6 | 42.9 | 53.9 | 49.6 | 49.8 | 53.2 | 51.2 | 61.6 | 49.7 | 49.3 | |
| Llama-3.1-8B-Instruct w/ WRLStrategy=WRL (Fine-grained Reward Modeling)2026.04 | 48.5 | — | — | 50.4 | 48.3 | 46.4 | 44.4 | 51.7 | 52.7 | 48.2 | 51.7 | 49 | 59 | 48.5 | 47.9 | |
| Llama-3.1-8B-InstructAccess=Capability-enhanced2026.04 | 47 | — | — | 48.5 | 46.6 | 44.7 | 43.4 | 50.3 | 51.9 | 46.9 | 50.5 | 47.4 | 56.6 | 46.8 | 45.2 | |
| Qwen2.5-1.5B-InstructAccess=Capability-enhanced2026.04 | 44.6 | — | — | 46 | 46.8 | 43.8 | 37.5 | 48.4 | 45 | 44.1 | 47.8 | 44.9 | 54.5 | 43.2 | 43.7 | |
| LongWriter-ZeroModel Scale=32B, Continual Pretrain=true, Thinking=true2025.06 | 8.69 | 8.8 | 8.6 | 8.7 | 8.8 | 8.8 | 8.4 | 8.9 | 8.6 | 8.7 | 8.9 | 8.7 | 9 | 8.6 | 8.5 | |
| Qwen3-235B-A22BModel Scale=235B-A22B2025.06 | 8.68 | 8.7 | 8.6 | 8.6 | 8.6 | 8.6 | 8.7 | 8.8 | 8.6 | 8.7 | 8.9 | 8.7 | 9 | 8.7 | 8.8 | |
| Claude-Sonnet-4Provider=Anthropic2025.06 | 8.6 | 8.6 | 8.5 | 8.6 | 8.6 | 8.5 | 8.6 | 8.7 | 8.5 | 8.6 | 8.8 | 8.6 | 9 | 8.6 | 8.6 | |
| DeepSeek-R1Provider=DeepSeek-AI2025.06 | 8.55 | 8.7 | 8.5 | 8.5 | 8.5 | 8.6 | 8.6 | 8.7 | 8.6 | 8.7 | 8.9 | 8.6 | 9 | 8.6 | 8.7 | |
| Qwen2.5-MaxProvider=Alibaba2025.06 | 8.37 | 8.4 | 8.3 | 8.3 | 8.3 | 8.4 | 8.4 | 8.5 | 8.4 | 8.5 | 8.7 | 8.4 | 9 | 8.4 | 8.5 | |
| GPT-4o-2024-11-20Provider=OpenAI2025.06 | 8.16 | 8.3 | 8.1 | 8.1 | 8.1 | 8.2 | 8.1 | 8.4 | 8.1 | 8.3 | 8.7 | 8.2 | 8.9 | 8.2 | 8.3 | |
| o1-PreviewProvider=OpenAI2025.06 | 8.15 | 8.1 | 8.2 | 8 | 8.1 | 8.2 | 8.2 | 8.4 | 8.1 | 8.2 | 8.6 | 8.2 | 8.8 | 8.2 | 8.2 | |
| LongWriter-ZeroModel Scale=32B, Continual Pretrain=false, Thinking=true2025.06 | 8.12 | 8.3 | 8 | 8.2 | 8.2 | 8.2 | 7.8 | 8.4 | 8.1 | 8.2 | 8.5 | 8.2 | 8.8 | 7.9 | 7.4 | |
| LongWriter-ZeroModel Scale=32B, Continual Pretrain=true, Thinking=false2025.06 | 8.04 | 8.2 | 7.9 | 8.2 | 8.1 | 8.1 | 7.6 | 8.4 | 8 | 8 | 8.3 | 8.1 | 8.6 | 7.9 | 7 | |
| DeepSeek-V3Provider=DeepSeek-AI2025.06 | 7.95 | 8 | 7.9 | 7.9 | 7.8 | 8 | 7.8 | 8.2 | 8 | 8.1 | 8.6 | 8 | 8.9 | 8 | 8.2 | |
| LongWriterModel Scale=8B2025.06 | 7.91 | 7.9 | 7.9 | 8 | 8.1 | 8.1 | 7.7 | 8.1 | 7.6 | 7.9 | 8.2 | 8.1 | 8.8 | 7.7 | 7.7 | |
| Qwen-2.5-72B-InstructModel Scale=72B2025.06 | 7.9 | 8 | 7.9 | 8 | 7.8 | 8.1 | 7.7 | 8.2 | 7.8 | 8 | 8.3 | 8 | 8.8 | 7.9 | 8 | |
| Mistral-Large-InstructProvider=Mistral2025.06 | 7.64 | 7.6 | 7.7 | 7.7 | 7.6 | 7.8 | 7.3 | 7.9 | 7.6 | 7.7 | 8.2 | 7.7 | 8.7 | 7.7 | 7.9 | |
| Qwen-2.5-7B-InstructModel Scale=7B2025.06 | 7.43 | 7.3 | 7.5 | 7.7 | 7.4 | 7.6 | 6.9 | 7.8 | 7.3 | 7.5 | 7.9 | 7.6 | 8.6 | 7.4 | 7.5 | |
| Llama-3.3-70B-InstructModel Scale=70B2025.06 | 7.01 | 6.7 | 7.3 | 7 | 6.9 | 7 | 6.8 | 7.3 | 7.3 | 7.1 | 7.8 | 7.1 | 8.2 | 7 | 7.2 | |
| Llama-3.1-8B-InstructModel Scale=8B2025.06 | 6.35 | 5.7 | 6.9 | 6.6 | 6.4 | 6.1 | 6 | 6.7 | 6.6 | 6.4 | 7 | 6.4 | 7.6 | 6.3 | 6.4 | |
| Suri-I-ORPOModel Scale=7B2025.06 | 4.97 | 4.4 | 5.5 | 5.6 | 5.3 | 5 | 4.1 | 5 | 5.1 | 4.8 | 5.2 | 5 | 5.4 | 4.5 | 4 |