Mathematical Reasoning on HLE math
23.3AccuracyLarge
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LargeAgent=DDV22026.03 | 23.3 | 28.41 | 1 | — | |
| AgentCollabAgent=DDV22026.03 | 21.1 | 32.03 | 2.31 | — | |
| FrugalGPTAgent=DDV22026.03 | 18.2 | 29.23 | 1.97 | — | |
| RouteLLMAgent=DDV22026.03 | 15.2 | 33.42 | 1.62 | — | |
| LargeAgent=WebSailor2026.03 | 14 | 7.09 | 1 | — | |
| AgentCollabAgent=WebSailor2026.03 | 13.3 | 8.57 | 1.29 | — | |
| FrugalGPTAgent=WebSailor2026.03 | 11.9 | 9.81 | 1.1 | — | |
| RouteLLMAgent=WebSailor2026.03 | 11.4 | 9.34 | 1.21 | — | |
| SmallAgent=WebSailor2026.03 | 11.3 | 13.02 | 2.48 | — | |
| RandomAgent=DDV22026.03 | 9.2 | 32.82 | 1.33 | — | |
| RandomAgent=WebSailor2026.03 | 9.2 | 14.02 | 1.03 | — | |
| SmallAgent=DDV22026.03 | 8 | 35.55 | 3.38 | — | |
| LCPOModel Scale=7B2025.08 | 4.51 | — | — | 5,873 | |
| OriginalModel Scale=7B2025.08 | 4.3 | — | — | 13,956 | |
| LCPOModel Scale=1.5B2025.08 | 3.48 | — | — | 6,217 | |
| OriginalModel Scale=1.5B2025.08 | 3.07 | — | — | 14,940 |