Domain Deep Research Tool Use on FinSearchComp Global-T2
70.6Success RateGemini-3-Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-3-ProCategory=Frontier (≫8B), Temperature=1, Top-p=1, Number of runs=42026.03 | 70.6 | |
| DIVE-8B (RL)Category=Ours, Temperature=1, Top-p=1, Number of runs=42026.03 | 67.3 | |
| DIVE-8B (SFT)Category=Ours, Temperature=1, Top-p=1, Number of runs=42026.03 | 62.1 | |
| DeepSeek-V3.2-ExpCategory=Frontier (≫8B), Temperature=1, Top-p=1, Number of runs=42026.03 | 61.3 | |
| GPT-OSS-120BCategory=Frontier (≫8B), Temperature=1, Top-p=1, Number of runs=42026.03 | 61 | |
| Claude-4-SonnetCategory=Frontier (≫8B), Temperature=1, Top-p=1, Number of runs=42026.03 | 60.2 | |
| Kimi-K2-0905Category=Frontier (≫8B), Temperature=1, Top-p=1, Number of runs=42026.03 | 47.1 | |
| Gemini-2.5-ProCategory=Frontier (≫8B), Temperature=1, Top-p=1, Number of runs=42026.03 | 44.5 | |
| EnvScaler-8BCategory=8B Baselines, Temperature=1, Top-p=1, Number of runs=42026.03 | 40.7 | |
| WebExplorer-8BCategory=8B Baselines, Temperature=1, Top-p=1, Number of runs=42026.03 | 35.9 | |
| SWE-Dev-8BCategory=8B Baselines, Temperature=1, Top-p=1, Number of runs=42026.03 | 30.5 | |
| Qwen3-8B (base)Category=Ours, Temperature=1, Top-p=1, Number of runs=42026.03 | 28.6 |