Autonomous Agent Problem Solving on Humanity's Last Exam
41.6Avg@3ChatGPT-Agent
Evaluation Results
| Method | Links | |
|---|---|---|
| ChatGPT-AgentType=Research Agents2025.11 | 41.6 | |
| MiroThinker-v1.0-72BParameters=72B2025.11 | 37.7 | |
| OpenAI-GPT-5-highType=Foundation Models with Tools2025.11 | 35.2 | |
| MiroThinker-v1.0-30BParameters=30B2025.11 | 33.4 | |
| Tongyi-DeepResearch-30BType=Research Agents2025.11 | 32.9 | |
| Minimax-M2Type=Foundation Models with Tools2025.11 | 31.8 | |
| GLM-4.6Type=Foundation Models with Tools2025.11 | 30.4 | |
| DeepSeek-V3.1Type=Foundation Models with Tools2025.11 | 29.8 | |
| SFR-DeepResearch-20BType=Research Agents2025.11 | 28.7 | |
| DeepSeek-V3.2Type=Foundation Models with Tools2025.11 | 27.2 | |
| Kimi-ResearcherType=Research Agents2025.11 | 26.9 | |
| OpenAI DeepResearchType=Research Agents2025.11 | 26.6 | |
| OpenAI-o3Type=Foundation Models with Tools2025.11 | 24.9 | |
| Claude-4.5-SonnetType=Foundation Models with Tools2025.11 | 24.5 | |
| Kimi-K2-0905Type=Foundation Models with Tools2025.11 | 21.7 | |
| MiroThinker-v1.0-8BParameters=8B2025.11 | 21.5 | |
| Claude-4-SonnetType=Foundation Models with Tools2025.11 | 20.3 | |
| AFM-32B-RLType=Research Agents2025.11 | 18 | |
| WebExplorer-8B-RLType=Research Agents2025.11 | 17.3 |