Knowledge-Intensive Reasoning on HLE
85Avg ScoreR1-Searcher
Evaluation results
| Method | Links | ||
|---|---|---|---|
| R1-SearcherCategory=RL-only TIR Methods2026.01 | 85 | — | |
| AutoTIRCategory=RL-only TIR Methods2026.01 | 85 | — | |
| AutoTrajCategory=SFT-RL TIR Methods2026.01 | 85 | — | |
| ReSearchCategory=RL-only TIR Methods2026.01 | 81 | — | |
| Qwen2.5-7B-InstructFramework=Multi-Dimensional Trajectory Evaluation2026.01 | 80 | — | |
| Vanilla SFT-RL TIRCategory=SFT-RL TIR Methods2026.01 | 76 | — | |
| ToRLCategory=RL-only TIR Methods2026.01 | 74 | — | |
| Tool-StarCategory=SFT-RL TIR Methods2026.01 | 74 | — | |
| Tool-Star-SFTCategory=SFT-only TIR Methods2026.01 | 72 | — | |
| Gemini-3-Pro-Preview2026.05 | 37.98 | — | |
| Kimi-K2.52026.05 | 28.64 | — | |
| DeepSeek-V3.2-Speciale2026.05 | 28.55 | — | |
| GPT-5-2025-08-07Setting=high2026.05 | 28.51 | — | |
| GLM-5Precision=FP82026.05 | 28.13 | — | |
| GLM-4-72026.05 | 25.39 | — | |
| DeepSeek-V3.22026.05 | 23.21 | — | |
| MiniMax-M2.52026.05 | 22.24 | — | |
| Step-3.5-Flash2026.05 | 21.59 | — | |
| GPT-5-mini-2025-08-07Setting=high2026.05 | 21.49 | — | |
| Kimi-K2Mode=Thinking2026.05 | 21.31 | — | |
| o3-2025-04-162026.05 | 21.31 | — | |
| Gemini-2.5-Pro2026.05 | 21.12 | — | |
| Mimo-V2-Flash2026.05 | 20.52 | — | |
| TeleChatMode=Thinking2026.05 | 20.29 | — | |
| GLM-4.62026.05 | 19.31 | — | |
| Qwen3Parameters=235B, Active Parameters=A22B, Mode=Thinking, Version=25072026.05 | 18.48 | — | |
| gpt-oss-120bSetting=high2026.05 | 18.34 | — | |
| GLM-4.52026.05 | 16.95 | — | |
| JTMode=Think2026.05 | 14.44 | — | |
| DeepSeek-R1-05282026.05 | 14.39 | — | |
| o4-mini-2025-04-16Setting=high2026.05 | 14.35 | — | |
| Qwen3-NextParameters=80B, Active Parameters=A3B, Mode=Thinking2026.05 | 13.46 | — | |
| doubao-seed-1.6Mode=thinking, Version=2506152026.05 | 13.46 | — | |
| MiniMax-M22026.05 | 13.37 | — | |
| Qwen3Parameters=235B, Active Parameters=A22B, Mode=Thinking2026.05 | 12.67 | — | |
| GLM-4.5-Air2026.05 | 12.58 | — | |
| Qwen3Parameters=235B, Active Parameters=A22B, Type=Instruct, Version=25072026.05 | 12.3 | — | |
| Qwen3Parameters=30B, Active Parameters=A3B, Mode=Thinking, Version=25072026.05 | 11.65 | — | |
| gpt-oss-20bSetting=high2026.05 | 11.56 | — | |
| GPT-5-nano-2025-08-07Setting=high2026.05 | 10.96 | — | |
| o3-mini-2025-04-16Setting=high2026.05 | 10.82 | — | |
| Seed-OSS-36BType=Instruct2026.05 | 9.52 | — | |
| MiniCPM-Sala2026.05 | 9.29 | — | |
| Claude Sonnet 4Mode=Thinking2026.05 | 8.73 | — | |
| LongCat-Flash-Chat2026.05 | 8.5 | — | |
| Qwen3-NextParameters=80B, Active Parameters=A3B, Type=Instruct2026.05 | 8.03 | — | |
| QwQ-32B2026.05 | 7.75 | — | |
| Qwen3Parameters=30B, Active Parameters=A3B, Type=Instruct, Version=25072026.05 | 7.66 | — | |
| GLM-Z1-32B-04142026.05 | 7.15 | — | |
| AutoTrajBackbone=Qwen2.5-7B, Training Paradigm=SFT–RL TIR, SFT Trajectory Count=13K2026.01 | 7 | — | |
| Finix-P1-32BMode=Thinking2026.05 | 6.92 | — | |
| Kimi-K2Type=Instruct2026.05 | 6.73 | — | |
| ERNIE-4.5Parameters=21B, Active Parameters=A3B, Mode=Thinking2026.05 | 6.55 | — | |
| ReSearchBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 6.4 | — | |
| Qwen3-4BMode=Thinking, Version=25072026.05 | 6.04 | — | |
| GPT-4.1-202504142026.05 | 6.04 | — | |
| Hunyuan-A13BType=Instruct2026.05 | 5.99 | — | |
| AutoTIRBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 5.7 | — | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B, Training Paradigm=Instruct2026.01 | 5.6 | — | |
| DeepSeek-Chat-V3-03242026.05 | 5.57 | — | |
| Llama4-MaverickParameters=17B, Experts=128E, Type=Instruct2026.05 | 5.34 | — | |
| Gemini 2.0 Flash2025.08 | 5.3 | 1 | |
| Vanilla SFT-RL TIRBackbone=Qwen2.5-7B, Training Paradigm=SFT–RL TIR2026.01 | 5.2 | — | |
| Qwen3-4BType=Instruct, Version=25072026.05 | 5.06 | — | |
| Tool-StarBackbone=Qwen2.5-7B, Training Paradigm=SFT–RL TIR, SFT Trajectory Count=54K2026.01 | 4.6 | — | |
| Tool-Star-SFTBackbone=Qwen2.5-7B, Training Paradigm=SFT-only, SFT Trajectory Count=54K2026.01 | 4.5 | — | |
| Gemma-3-27B-it2026.05 | 4.22 | — | |
| ToRLBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 4.2 | — | |
| Sonnet 42025.08 | 4 | 2 | |
| GLM-4-32B-04142026.05 | 3.99 | — | |
| R1-SearcherBackbone=Qwen2.5-7B, Training Paradigm=RL-only2026.01 | 3.9 | — | |
| Sonnet 3.5Date=2024-10-222025.08 | 3.9 | 3 | |
| ERNIE-4.5Parameters=300B, Active Parameters=A47B, Type=PT2026.05 | 3.81 | — | |
| Haiku 3.52025.08 | 3.5 | 4 | |
| GPT-4oDate=2024-11-202025.08 | 3.3 | 5 |