Deep Research Report Generation on DeepResearch Bench
52.84Comprehensivenesstavily-research
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| tavily-research2026.01 | 52.84 | 52.44 | 53.59 | 51.92 | 49.21 | |
| Tavily Research2026.01 | 52.84 | 52.44 | 53.59 | 51.92 | 49.21 | |
| ADORE2026.01 | 52.22 | 52.65 | 54.37 | 51.11 | 52.18 | |
| CellCog2026.01 | 52.17 | 51.94 | 51.9 | 51.37 | 51.94 | |
| ThinkDepthAI2026.01 | 52.02 | 52.43 | 53.88 | 52.04 | 50.12 | |
| WebWeaverSystem category=Prompt-Based Frameworks, Base model=Claude-Sonnet-42026.02 | 51.45 | 50.58 | 50.02 | 50.81 | 49.79 | |
| AgentCPM-Report (Pipeline RL)System category=Our Deep Research Systems, Training strategy=Pipeline RL2026.02 | 50.54 | 50.11 | 52.64 | 48.87 | 44.17 | |
| RhinoInsighSystem category=Prompt-Based Frameworks, Base model=Gemini-2.5-Pro2026.02 | 50.51 | 50.92 | 51.45 | 51.72 | 50 | |
| LangChainBackbone=GPT-52026.01 | 50.06 | 50.6 | 50.76 | 51.31 | 49.72 | |
| Salesforce Air2026.01 | 50 | 50.65 | 51.09 | 50.77 | 50.32 | |
| Gemini Deep ResearchCategory=Framework2026.06 | 49.82 | 50.04 | 46.79 | 51.69 | 49.14 | |
| LangChainIntegration=Tavily2026.01 | 49.8 | 49.33 | 47.34 | 51.05 | 48.99 | |
| Gemini-2.5-Pro-deepresearchSystem category=Proprietary Deep Research Systems2026.02 | 49.51 | 49.71 | 49.45 | 50.12 | 50 | |
| gemini-2.5-pro-deepresearch2026.01 | 49.51 | 49.71 | 49.45 | 50.12 | 50 | |
| Gemini 2.5 Pro2026.01 | 49.51 | 49.71 | 49.45 | 50.12 | 50 | |
| Enterprise DRSystem category=Prompt-Based Frameworks, Base model=Gemini-2.5-Pro2026.02 | 49.01 | 49.86 | 50.28 | 50.03 | 49.98 | |
| AgentCPM-Report (Atomic RL)System category=Our Deep Research Systems, Training strategy=Atomic RL2026.02 | 48.7 | 48.81 | 51.36 | 48.64 | 42.25 | |
| Gemini-2.5-Pro Deep ResearchAgent Type=Deep Research Agents2026.04 | 48.45 | 48.92 | 48.3 | 49.29 | 49.77 | |
| MASS Deep ResearchCategory=Framework2026.06 | 46.73 | 48.23 | 52.23 | 45.42 | 46.38 | |
| Tongyi Deep ResearchCategory=Framework2026.06 | 46.7 | 47.89 | 46.71 | 48.97 | 49.35 | |
| OpenAI-deepresearchSystem category=Proprietary Deep Research Systems2026.02 | 46.46 | 46.45 | 43.73 | 49.39 | 47.22 | |
| openai-deep-research2026.01 | 46.46 | 46.45 | 43.73 | 49.39 | 47.22 | |
| OpenAI Deep Research2026.01 | 46.46 | 46.45 | 43.73 | 49.39 | 47.22 | |
| OpenAI Deep ResearchAgent Type=Deep Research Agents2026.04 | 46.46 | 46.45 | 43.73 | 49.39 | 47.22 | |
| AgentCPM-Report (SFT)System category=Our Deep Research Systems, Training strategy=SFT2026.02 | 46.24 | 46.73 | 48.1 | 47.61 | 41.79 | |
| Qwen3-235BCategory=Model2026.06 | 46.16 | 46.12 | 44.9 | 47.68 | 47.87 | |
| Claude-researchSystem category=Proprietary Deep Research Systems2026.02 | 45.34 | 45 | 42.79 | 47.58 | 44.66 | |
| claude-research2026.01 | 45.34 | 45 | 42.79 | 47.58 | 44.66 | |
| Claude Research2026.01 | 45.34 | 45 | 42.79 | 47.58 | 44.66 | |
| Claude-ResearcherAgent Type=Deep Research Agents2026.04 | 45.34 | 45 | 42.79 | 47.58 | 44.66 | |
| WebWeaverSystem category=Prompt-Based Frameworks, Base model=Qwen3-30B-A3B2026.02 | 45.15 | 46.77 | 45.78 | 49.21 | 47.34 | |
| Kimi-ResearcherAgent Type=Deep Research Agents2026.04 | 44.96 | 44.64 | 41.97 | 47.14 | 45.59 | |
| Doubao-researchSystem category=Proprietary Deep Research Systems2026.02 | 44.84 | 44.34 | 40.56 | 47.95 | 44.69 | |
| Doubao-DeepResearchAgent Type=Deep Research Agents2026.04 | 44.84 | 44.34 | 40.56 | 47.95 | 44.69 | |
| DeepSeek-V3.1Category=Model2026.06 | 44.83 | 45.68 | 44.33 | 48.13 | 46.49 | |
| WebThinkerGeneration Type=Text-Only Generation, Base Model=Qwen3-32B2026.05 | 44.63 | 45 | 43.26 | 46.86 | 46.61 | |
| GLM-4.6Category=Model2026.06 | 44.32 | 44.05 | 42.09 | 46.83 | 44.68 | |
| Claude-Sonnet-4.5Category=Model2026.06 | 43.57 | 44.76 | 42.6 | 46.99 | 44.28 | |
| deepresearcher-reflect-evolve2026.01 | 43.44 | 46.21 | 45.48 | 48.99 | 48.21 | |
| IntentRL clarifyAgent=Gemini Deep Research Agent2026.02 | 43.1 | 45.27 | 45.02 | 44.04 | 48.5 | |
| PTAHGeneration Type=Multimodal Generation, Planner=Qwen3-32B, Writer=Qwen3-VL-32B-Instruct2026.05 | 42.97 | 45.16 | 44.32 | 46.71 | 47.95 | |
| ReActGeneration Type=Text-Only Generation, Base Model=Qwen3-32B2026.05 | 42.63 | 43.7 | 40.42 | 47.66 | 46.37 | |
| DR Tulu-8BSystem category=Trained Open Models2026.02 | 41.7 | — | 41.8 | 48.2 | 41.3 | |
| Search-o1Generation Type=Text-Only Generation, Base Model=Qwen3-32B2026.05 | 41.57 | 42.91 | 39.7 | 46.82 | 45.96 | |
| IntentRL clarifyAgent=Qwen Deep Research Agent2026.02 | 41.49 | 43.65 | 44.06 | 43.19 | 47.04 | |
| QwQ-32BGeneration Type=Direct Generation, Base Model=QwQ-32B2026.05 | 40.97 | 42.59 | 40.27 | 46.09 | 45.23 | |
| Learn-to-Ask clarifyAgent=Gemini Deep Research Agent2026.02 | 40.87 | 43.66 | 43.43 | 43.07 | 49.42 | |
| Qwen3-32BGeneration Type=Direct Generation, Base Model=Qwen3-32B2026.05 | 40.73 | 42.22 | 39.59 | 45.85 | 44.8 | |
| IntentRL clarifyAgent=OpenAI Deep Research Agent2026.02 | 40.71 | 44.86 | 40.07 | 42.71 | 50.78 | |
| ERNIE-4.5Category=Model2026.06 | 40.5 | 42.82 | 38.39 | 44.85 | 43.32 | |
| CollabLLM clarifyAgent=Gemini Deep Research Agent2026.02 | 40.37 | 43.13 | 43.28 | 42.11 | 48.83 | |
| IntentRL clarifyAgent=Tavily Deep Research Agent2026.02 | 39.9 | 42.14 | 42.17 | 41.98 | 45.39 | |
| CollabLLM clarifyAgent=Qwen Deep Research Agent2026.02 | 39.65 | 41.86 | 42.16 | 40.4 | 46.83 | |
| Learn-to-Ask clarifyAgent=Qwen Deep Research Agent2026.02 | 39.62 | 41.81 | 41.87 | 40.51 | 46.88 | |
| WebThinker-32B-DPOSystem category=Trained Open Models, Training strategy=DPO2026.02 | 39.4 | — | 35.4 | 46 | 43.5 | |
| Learn-to-Ask clarifyAgent=Tavily Deep Research Agent2026.02 | 39.16 | 41.12 | 41.08 | 40.31 | 45.99 | |
| perplexity-research2026.01 | 39.1 | 40.46 | 35.65 | 46.11 | 43.08 | |
| Perplexity-ResearchAgent Type=Deep Research Agents2026.04 | 39.1 | 40.46 | 35.65 | 46.11 | 43.08 | |
| Qwen clarifyAgent=Qwen Deep Research Agent2026.02 | 38.6 | 40.72 | 40.66 | 39.07 | 46.48 | |
| CollabLLM clarifyAgent=Tavily Deep Research Agent2026.02 | 38.2 | 40.39 | 40.23 | 39.52 | 45.17 | |
| nvidia-aiq-research-assistant2026.01 | 37.98 | 40.52 | 38.39 | 44.59 | 42.63 | |
| OpenAI clarifyAgent=OpenAI Deep Research Agent2026.02 | 37.82 | 40.26 | 36.87 | 40.09 | 50.76 | |
| Tell Me More clarifyAgent=Gemini Deep Research Agent2026.02 | 37.44 | 40.56 | 40.42 | 38.45 | 48.24 | |
| no clarifyAgent=Tavily Deep Research Agent2026.02 | 37.12 | 39.42 | 39.1 | 37.78 | 45.64 | |
| no clarifyAgent=Qwen Deep Research Agent2026.02 | 36.92 | 39.39 | 39.31 | 37.27 | 46.32 | |
| no clarifyAgent=Gemini Deep Research Agent2026.02 | 36.66 | 39.41 | 38.17 | 37.74 | 48.06 | |
| Tell Me More clarifyAgent=Qwen Deep Research Agent2026.02 | 36.47 | 39.32 | 39.22 | 37.08 | 46.65 | |
| Learn-to-Ask clarifyAgent=OpenAI Deep Research Agent2026.02 | 36.24 | 41.5 | 36.95 | 40.61 | 50.48 | |
| Tell Me More clarifyAgent=Tavily Deep Research Agent2026.02 | 36.21 | 38.58 | 37.95 | 36.61 | 45.5 | |
| grok-deeper-search2026.01 | 36.08 | 38.22 | 30.89 | 46.59 | 42.17 | |
| Grok Deeper SearchAgent Type=Deep Research Agents2026.04 | 36.08 | 38.22 | 30.89 | 46.59 | 42.17 | |
| Claude-3.7-Sonnet w/SearchAgent Type=LLM with Search Tools2026.04 | 35.95 | 36.63 | 31.29 | 44.05 | 36.07 | |
| CollabLLM clarifyAgent=OpenAI Deep Research Agent2026.02 | 35.87 | 40.12 | 37.28 | 38.46 | 50.05 | |
| LLM-IGeneration Type=Multimodal Generation, Base Model=Qwen3-32B2026.05 | 35.14 | 36.36 | 31.77 | 41.14 | 40.07 | |
| Perplexity-Sonar-Reasoning-ProAgent Type=LLM with Search Tools2026.04 | 34.96 | 37.76 | 31.65 | 44.93 | 42.42 | |
| Perplexity-Sonar-ReasoningAgent Type=LLM with Search Tools2026.04 | 34.73 | 37.75 | 32.59 | 44.42 | 42.39 | |
| Perplexity-Sonar-ProAgent Type=LLM with Search Tools2026.04 | 33.92 | 36.19 | 29.69 | 43.39 | 41.07 | |
| Ours (Report)Agent Type=LLM with Search Tools2026.04 | 32.15 | 34.13 | 28.07 | 41.25 | 38.19 | |
| Gemini-2.5-Pro-PreviewAgent Type=LLM with Search Tools2026.04 | 31.75 | 31.9 | 24.61 | 40.24 | 32.76 | |
| WebShaper-32BSystem category=Trained Open Models2026.02 | 31.58 | 34.93 | 26.17 | 44.81 | 40.38 | |
| Tell Me More clarifyAgent=OpenAI Deep Research Agent2026.02 | 31.47 | 36.99 | 32.8 | 34.1 | 48.08 | |
| no clarifyAgent=OpenAI Deep Research Agent2026.02 | 30.46 | 36.62 | 30.5 | 34.62 | 48.42 | |
| Gemini-2.5-Flash-PreviewAgent Type=LLM with Search Tools2026.04 | 28.97 | 29.19 | 21.62 | 37.8 | 29.97 | |
| GPT-4o-Search-PreviewAgent Type=LLM with Search Tools2026.04 | 27.81 | 30.74 | 20.44 | 41.01 | 37.6 | |
| Perplexity-SonarAgent Type=LLM with Search Tools2026.04 | 27.14 | 30.64 | 21.62 | 40.7 | 37.46 | |
| GPT-4.1 w/SearchAgent Type=LLM with Search Tools2026.04 | 25.59 | 29.31 | 18.42 | 40.63 | 36.49 | |
| GPT-4o-Mini-Search-PreviewAgent Type=LLM with Search Tools2026.04 | 24.24 | 27.62 | 16.62 | 38.59 | 35.27 | |
| GPT-4.1-Mini w/SearchAgent Type=LLM with Search Tools2026.04 | 22.86 | 26.62 | 15.39 | 38.18 | 34.49 | |
| Claude-3.5-Sonnet w/SearchAgent Type=LLM with Search Tools2026.04 | 21.28 | 23.95 | 16.2 | 32.41 | 29.87 |