Long-form research on DRB
50.7ScoreGPT-5 + Search
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-5 + SearchCategory=Closed Deep Research2026.05 | 50.7 | |
| GPT-5 + SearchModel Category=Closed Deep Research2025.11 | 50.7 | |
| GPT-5 + Our SearchModel Category=Closed Deep Research2025.11 | 50.3 | |
| Gemini Deep ResearchCategory=Closed Deep Research2026.05 | 48.8 | |
| Gemini Deep ResearchModel Category=Closed Deep Research, Evaluation Protocol=original author report2025.11 | 48.8 | |
| RubricEM-8B (RL, 1400 steps)Backbone=8B, Training=RL, Steps=14002026.05 | 47.8 | |
| OpenAI Deep ResearchCategory=Closed Deep Research2026.05 | 46.9 | |
| OpenAI Deep ResearchModel Category=Closed Deep Research, Evaluation Protocol=original author report2025.11 | 46.9 | |
| Gemini 3 Pro + SearchModel Category=Closed Deep Research2025.11 | 46.3 | |
| DR Tulu-8B (RL)Model Category=Open Deep Research (Ours), Training Strategy=RL2025.11 | 45.4 | |
| Gemini 3.1 Pro + SearchCategory=Closed Deep Research2026.05 | 44.4 | |
| DR Tulu-8B (RL, 1900 steps)Category=Open Deep Research Models, Backbone=8B, Training=RL, Steps=19002026.05 | 43.4 | |
| RubricEM-8B (SFT)Backbone=8B, Training=SFT2026.05 | 43 | |
| Perplexity Deep ResearchCategory=Closed Deep Research2026.05 | 42.3 | |
| Perplexity Deep ResearchModel Category=Closed Deep Research, Evaluation Protocol=original author report2025.11 | 42.3 | |
| Perplexity-Sonar (High)Category=Closed Deep Research2026.05 | 40.7 | |
| Perplexity-Sonar (High)Model Category=Closed Deep Research, Evaluation Protocol=original author report2025.11 | 40.7 | |
| WebThinker-32B-DPOCategory=Fixed Pipeline Deep Research, Backbone=32B, Alignment=DPO2026.05 | 40.6 | |
| Tongyi DeepResearch-30B-A3BCategory=Open Deep Research Models, Backbone=30B-A3B2026.05 | 40.6 | |
| Tongyi DeepResearch-30B-A3BModel Category=Open Deep Research Models2025.11 | 40.6 | |
| WebThinker-32B-DPO (report)Model Category=Fixed Pipeline Deep Research2025.11 | 40.6 | |
| QwQ-32BModel Category=Naive RAG2025.11 | 40.3 | |
| DR Tulu-8B (SFT)Category=Open Deep Research Models, Backbone=8B, Training=SFT2026.05 | 39 | |
| DR Tulu-8B (SFT)Model Category=Open Deep Research (Ours), Training Strategy=SFT2025.11 | 39 | |
| WebThinker QwQ-32BCategory=Fixed Pipeline Deep Research, Backbone=QwQ-32B2026.05 | 37.9 | |
| WebThinker QwQ-32B (report)Model Category=Fixed Pipeline Deep Research2025.11 | 37.9 | |
| WebExplorer-8BCategory=Open Deep Research Models, Backbone=8B2026.05 | 36.7 | |
| WebExplorer-8BModel Category=Open Deep Research Models2025.11 | 36.7 | |
| Ai2 ScholarQA – Claude SonnetCategory=Fixed Pipeline Deep Research, Backbone=Claude Sonnet2026.05 | 36.1 | |
| Ai2 ScholarQA - Claude SonnetModel Category=Fixed Pipeline Deep Research2025.11 | 36.1 | |
| Claude-Sonnet SearchCategory=Closed Deep Research2026.05 | 34.5 | |
| Claude-Sonnet SearchModel Category=Closed Deep Research, Evaluation Protocol=original author report2025.11 | 34.5 | |
| Qwen3-8BModel Category=Naive RAG2025.11 | 33.3 | |
| Qwen3-8B + Our SearchBackbone=Qwen3-8B, Search=Our Search2026.05 | 28.2 | |
| WebThinker-32B-DPOModel Category=Open Deep Research Models2025.11 | 23.3 | |
| Qwen3-8B + Our SearchModel Category=Open Deep Research (Ours)2025.11 | 18.2 | |
| Search-R1-7BCategory=Open Deep Research Models, Backbone=R1-7B2026.05 | 9.5 | |
| Search-R1-7BModel Category=Open Deep Research Models2025.11 | 9.5 | |
| ASearcher-Web-7BModel Category=Open Deep Research Models2025.11 | 7.8 |