Report Generation on DeepResearch Bench
48.27Overall ScoreSCAFFOLDAGENT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SCAFFOLDAGENTBackbone=DeepSeek-V3.2, Paradigm=Multi-Agent2026.06 | 48.27 | 46.4 | 49.67 | 48.98 | 47.31 | 51.18 | 62.2 | |
| StackPlannerBackbone=DeepSeek-V3.2, Paradigm=Multi-Agent2026.06 | 46.82 | 46.42 | 46.29 | 48.25 | 46.75 | 32.75 | 50.4 | |
| SCAFFOLDAGENTBackbone=Qwen3-32B, Paradigm=Multi-Agent2026.06 | 44.7 | 43.54 | 45.25 | 46.49 | 42.85 | 30.42 | 54.32 | |
| PromptBackbone=DeepSeek-V3.2, Paradigm=Naive2026.06 | 43.68 | 41.77 | 41.67 | 47.21 | 46.35 | — | — | |
| WebWeaverBackbone=DeepSeek-V3.2, Paradigm=Multi-Agent2026.06 | 43.52 | 41.27 | 42.37 | 47.18 | 44.91 | 39 | 88.35 | |
| ReActBackbone=DeepSeek-V3.2, Paradigm=Single-Agent2026.06 | 43.26 | 42.7 | 40.53 | 46.1 | 46.43 | 4.15 | 17.83 | |
| EDRBackbone=DeepSeek-V3.2, Paradigm=Multi-Agent2026.06 | 43.13 | 41.95 | 40.27 | 46.24 | 44.5 | 24.28 | 34.79 | |
| IRCoTBackbone=Qwen3-32B, Paradigm=Single-Agent2026.06 | 42.46 | 40.7 | 39.55 | 46.23 | 45.7 | 15.77 | 40.04 | |
| ReActBackbone=Qwen3-32B, Paradigm=Single-Agent2026.06 | 42.21 | 40.66 | 38.65 | 46.1 | 44.56 | 4.69 | 23.78 | |
| StackPlannerBackbone=Qwen3-32B, Paradigm=Multi-Agent2026.06 | 41.55 | 39.84 | 37.79 | 46.41 | 44.79 | 9.63 | 26.5 | |
| WebWeaverBackbone=Qwen3-32B, Paradigm=Multi-Agent2026.06 | 41.28 | 39.88 | 39.68 | 44.65 | 39.69 | 8.42 | 32.72 | |
| EDRBackbone=Qwen3-32B, Paradigm=Multi-Agent2026.06 | 40.99 | 39.49 | 34.61 | 45.22 | 39.65 | 18.78 | 23.7 | |
| IRCoTBackbone=DeepSeek-V3.2, Paradigm=Single-Agent2026.06 | 39.73 | 36.8 | 36.81 | 44.57 | 40.7 | 34.83 | 75.18 | |
| PromptBackbone=Qwen3-32B, Paradigm=Naive2026.06 | 39.54 | 36.87 | 35.25 | 45.34 | 43.67 | — | — | |
| RAGBackbone=DeepSeek-V3.2, Paradigm=Naive2026.06 | 39.5 | 36.46 | 37.19 | 43.35 | 42.83 | 5.51 | 16.18 | |
| RAGBackbone=Qwen3-32B, Paradigm=Naive2026.06 | 36.68 | 34.49 | 33.35 | 43.07 | 42.92 | 2.93 | 10.86 | |
| STORMBackbone=DeepSeek-V3.2, Paradigm=Multi-Agent2026.06 | 35.26 | 33.69 | 31.52 | 39.02 | 39.07 | 17.42 | 38.59 | |
| WebShaperBackbone=Qwen3-32B, Paradigm=Single-Agent2026.06 | 34.93 | 31.58 | 26.17 | 44.81 | 40.38 | — | — | |
| WebShaperBackbone=DeepSeek-V3.2, Paradigm=Single-Agent2026.06 | 34.93 | 31.58 | 26.17 | 44.81 | 40.38 | — | — | |
| STORMBackbone=Qwen3-32B, Paradigm=Multi-Agent2026.06 | 32.81 | 30.63 | 31.66 | 34.88 | 36.9 | 15.18 | 36.9 |