Deep Research Report Generation on DeepResearch Bench

52.84Comprehensivenesstavily-research

Evaluation Results

Method
tavily-research2026.01	52.84	52.44	53.59	51.92	49.21
Tavily Research2026.01	52.84	52.44	53.59	51.92	49.21
ADORE2026.01	52.22	52.65	54.37	51.11	52.18
CellCog2026.01	52.17	51.94	51.9	51.37	51.94
ThinkDepthAI2026.01	52.02	52.43	53.88	52.04	50.12
WebWeaver2026.02	51.45	50.58	50.02	50.81	49.79
AgentCPM-Report (Pipeline RL)2026.02	50.54	50.11	52.64	48.87	44.17
RhinoInsigh2026.02	50.51	50.92	51.45	51.72	50
LangChain2026.01	50.06	50.6	50.76	51.31	49.72
Salesforce Air2026.01	50	50.65	51.09	50.77	50.32
Gemini Deep Research2026.06	49.82	50.04	46.79	51.69	49.14
LangChain2026.01	49.8	49.33	47.34	51.05	48.99
Gemini-2.5-Pro-deepresearch2026.02	49.51	49.71	49.45	50.12	50
gemini-2.5-pro-deepresearch2026.01	49.51	49.71	49.45	50.12	50
Gemini 2.5 Pro2026.01	49.51	49.71	49.45	50.12	50
Enterprise DR2026.02	49.01	49.86	50.28	50.03	49.98
AgentCPM-Report (Atomic RL)2026.02	48.7	48.81	51.36	48.64	42.25
Gemini-2.5-Pro Deep Research2026.04	48.45	48.92	48.3	49.29	49.77
MASS Deep Research2026.06	46.73	48.23	52.23	45.42	46.38
Tongyi Deep Research2026.06	46.7	47.89	46.71	48.97	49.35
OpenAI-deepresearch2026.02	46.46	46.45	43.73	49.39	47.22
openai-deep-research2026.01	46.46	46.45	43.73	49.39	47.22
OpenAI Deep Research2026.01	46.46	46.45	43.73	49.39	47.22
OpenAI Deep Research2026.04	46.46	46.45	43.73	49.39	47.22
AgentCPM-Report (SFT)2026.02	46.24	46.73	48.1	47.61	41.79
Qwen3-235B2026.06	46.16	46.12	44.9	47.68	47.87
Claude-research2026.02	45.34	45	42.79	47.58	44.66
claude-research2026.01	45.34	45	42.79	47.58	44.66
Claude Research2026.01	45.34	45	42.79	47.58	44.66
Claude-Researcher2026.04	45.34	45	42.79	47.58	44.66
WebWeaver2026.02	45.15	46.77	45.78	49.21	47.34
Kimi-Researcher2026.04	44.96	44.64	41.97	47.14	45.59
Doubao-research2026.02	44.84	44.34	40.56	47.95	44.69
Doubao-DeepResearch2026.04	44.84	44.34	40.56	47.95	44.69
DeepSeek-V3.12026.06	44.83	45.68	44.33	48.13	46.49
WebThinker2026.05	44.63	45	43.26	46.86	46.61
GLM-4.62026.06	44.32	44.05	42.09	46.83	44.68
Claude-Sonnet-4.52026.06	43.57	44.76	42.6	46.99	44.28
deepresearcher-reflect-evolve2026.01	43.44	46.21	45.48	48.99	48.21
IntentRL clarify2026.02	43.1	45.27	45.02	44.04	48.5
PTAH2026.05	42.97	45.16	44.32	46.71	47.95
ReAct2026.05	42.63	43.7	40.42	47.66	46.37
DR Tulu-8B2026.02	41.7	—	41.8	48.2	41.3
Search-o12026.05	41.57	42.91	39.7	46.82	45.96
IntentRL clarify2026.02	41.49	43.65	44.06	43.19	47.04
QwQ-32B2026.05	40.97	42.59	40.27	46.09	45.23
Learn-to-Ask clarify2026.02	40.87	43.66	43.43	43.07	49.42
Qwen3-32B2026.05	40.73	42.22	39.59	45.85	44.8
IntentRL clarify2026.02	40.71	44.86	40.07	42.71	50.78
ERNIE-4.52026.06	40.5	42.82	38.39	44.85	43.32
CollabLLM clarify2026.02	40.37	43.13	43.28	42.11	48.83
IntentRL clarify2026.02	39.9	42.14	42.17	41.98	45.39
CollabLLM clarify2026.02	39.65	41.86	42.16	40.4	46.83
Learn-to-Ask clarify2026.02	39.62	41.81	41.87	40.51	46.88
WebThinker-32B-DPO2026.02	39.4	—	35.4	46	43.5
Learn-to-Ask clarify2026.02	39.16	41.12	41.08	40.31	45.99
perplexity-research2026.01	39.1	40.46	35.65	46.11	43.08
Perplexity-Research2026.04	39.1	40.46	35.65	46.11	43.08
Qwen clarify2026.02	38.6	40.72	40.66	39.07	46.48
CollabLLM clarify2026.02	38.2	40.39	40.23	39.52	45.17
nvidia-aiq-research-assistant2026.01	37.98	40.52	38.39	44.59	42.63
OpenAI clarify2026.02	37.82	40.26	36.87	40.09	50.76
Tell Me More clarify2026.02	37.44	40.56	40.42	38.45	48.24
no clarify2026.02	37.12	39.42	39.1	37.78	45.64
no clarify2026.02	36.92	39.39	39.31	37.27	46.32
no clarify2026.02	36.66	39.41	38.17	37.74	48.06
Tell Me More clarify2026.02	36.47	39.32	39.22	37.08	46.65
Learn-to-Ask clarify2026.02	36.24	41.5	36.95	40.61	50.48
Tell Me More clarify2026.02	36.21	38.58	37.95	36.61	45.5
grok-deeper-search2026.01	36.08	38.22	30.89	46.59	42.17
Grok Deeper Search2026.04	36.08	38.22	30.89	46.59	42.17
Claude-3.7-Sonnet w/Search2026.04	35.95	36.63	31.29	44.05	36.07
CollabLLM clarify2026.02	35.87	40.12	37.28	38.46	50.05
LLM-I2026.05	35.14	36.36	31.77	41.14	40.07
Perplexity-Sonar-Reasoning-Pro2026.04	34.96	37.76	31.65	44.93	42.42
Perplexity-Sonar-Reasoning2026.04	34.73	37.75	32.59	44.42	42.39
Perplexity-Sonar-Pro2026.04	33.92	36.19	29.69	43.39	41.07
Ours (Report)2026.04	32.15	34.13	28.07	41.25	38.19
Gemini-2.5-Pro-Preview2026.04	31.75	31.9	24.61	40.24	32.76
WebShaper-32B2026.02	31.58	34.93	26.17	44.81	40.38
Tell Me More clarify2026.02	31.47	36.99	32.8	34.1	48.08
no clarify2026.02	30.46	36.62	30.5	34.62	48.42
Gemini-2.5-Flash-Preview2026.04	28.97	29.19	21.62	37.8	29.97
GPT-4o-Search-Preview2026.04	27.81	30.74	20.44	41.01	37.6
Perplexity-Sonar2026.04	27.14	30.64	21.62	40.7	37.46
GPT-4.1 w/Search2026.04	25.59	29.31	18.42	40.63	36.49
GPT-4o-Mini-Search-Preview2026.04	24.24	27.62	16.62	38.59	35.27
GPT-4.1-Mini w/Search2026.04	22.86	26.62	15.39	38.18	34.49
Claude-3.5-Sonnet w/Search2026.04	21.28	23.95	16.2	32.41	29.87