Deep Search on BrowseComp (test)
49.7AccuracyOpenAI-o3
Evaluation results
| Method | Links | |
|---|---|---|
| OpenAI-o3Context Budget=128k2026.01 | 49.7 | |
| GLM-4.6Context Budget=128k2026.01 | 45.1 | |
| Tongyi-DeepResearchContext Budget=128k2026.01 | 43.4 | |
| DeepSeek-v3.1Context Budget=128k2026.01 | 30 | |
| GLM-4.5Context Budget=128k2026.01 | 26.4 | |
| DeepDive-30B-SFT + C-GRPOContext Budget=128k2026.01 | 24.8 | |
| DeepDive-30B-SFTContext Budget=128k2026.01 | 20.5 | |
| DeepDive-30B-SFT + GRPOContext Budget=128k2026.01 | 18.9 | |
| DeepDive-30B-SFT + E-GRPOContext Budget=128k2026.01 | 18.5 | |
| DeepDive-30B-SFT + C-GRPOContext Budget=64k2026.01 | 17.9 | |
| DeepDive-4B-SFT + C-GRPOContext Budget=128k2026.01 | 17.5 | |
| DeepDive-30B-SFT + GRPOContext Budget=64k2026.01 | 16 | |
| DeepDive-32BContext Budget=128k2026.01 | 15.3 | |
| WebExplorer-8BContext Budget=128k2026.01 | 15.2 | |
| DeepDive-4B-SFT + GRPOContext Budget=128k2026.01 | 14.7 | |
| DeepDive-4B-SFT + E-GRPOContext Budget=128k2026.01 | 14.5 | |
| DeepDive-4B-SFTContext Budget=128k2026.01 | 14.1 | |
| DeepDive-4B-SFT + C-GRPOContext Budget=64k2026.01 | 13.9 | |
| DeepDive-30B-SFT + E-GRPOContext Budget=64k2026.01 | 13.1 | |
| DeepDive-4B-SFT + GRPOContext Budget=64k2026.01 | 12.9 | |
| DeepDive-30B-SFTContext Budget=64k2026.01 | 12.2 | |
| DeepDive-4B-SFT + E-GRPOContext Budget=64k2026.01 | 11.5 | |
| WebSailor-32BContext Budget=32k2026.01 | 10.5 | |
| DeepDive-4B-SFTContext Budget=64k2026.01 | 7.7 | |
| WebSailor-7BContext Budget=32k2026.01 | 6.7 | |
| DeepDive-9BContext Budget=128k2026.01 | 6.3 | |
| Asearcher-Web-32BContext Budget=128k2026.01 | 5.2 |