Science on GPQA
85.7AccuracyGPT-5
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5Evaluation Protocol=Closed-Source2026.01 | 85.7 | |
| Gemini2.5-ProEvaluation Protocol=Closed-Source2026.01 | 84 | |
| GPT-4.1Evaluation Protocol=Closed-Source2026.01 | 62.1 | |
| DyLANBackbone=Llama-3.3-70B-Instruct2025.05 | 54 | |
| CoTBackbone=Llama-3.3-70B-Instruct2025.05 | 53 | |
| SCBackbone=Llama-3.3-70B-Instruct2025.05 | 52.5 | |
| DebateBackbone=Llama-3.3-70B-Instruct2025.05 | 51 | |
| AgentVerseBackbone=Llama-3.3-70B-Instruct2025.05 | 51 | |
| MacNetBackbone=Llama-3.3-70B-Instruct2025.05 | 51 | |
| MADBackbone=Llama-3.3-70B-Instruct2025.05 | 50 | |
| ReasoningBackbone=Qwen2.5-7B family2026.01 | 49.1 | |
| SCBackbone=Qwen-2.5-72B-Instruct2025.05 | 49 | |
| DebateBackbone=Qwen-2.5-72B-Instruct2025.05 | 49 | |
| MAS-GPTBackbone=Qwen-2.5-72B-Instruct2025.05 | 49 | |
| MAS-GPTBackbone=Llama-3.3-70B-Instruct2025.05 | 48.5 | |
| SingleBackbone=Llama-3.3-70B-Instruct2025.05 | 48 | |
| AFlow-MathBackbone=Llama-3.3-70B-Instruct2025.05 | 48 | |
| AFlow-MathBackbone=Qwen-2.5-72B-Instruct2025.05 | 47.5 | |
| CoTBackbone=Qwen-2.5-72B-Instruct2025.05 | 47 | |
| MADBackbone=Qwen-2.5-72B-Instruct2025.05 | 47 | |
| MAVBackbone=Qwen-2.5-72B-Instruct2025.05 | 46.5 | |
| ATLAS (cluster)Evaluation Protocol=In-Distribution2026.01 | 46.4 | |
| AgentVerseBackbone=Qwen-2.5-72B-Instruct2025.05 | 46 | |
| MAVBackbone=Llama-3.3-70B-Instruct2025.05 | 45 | |
| SingleBackbone=Qwen-2.5-72B-Instruct2025.05 | 45 | |
| GPT-4oEvaluation Protocol=Closed-Source2026.01 | 44.4 | |
| AutoGenBackbone=Qwen-2.5-72B-Instruct2025.05 | 44.4 | |
| DyLANBackbone=Qwen-2.5-72B-Instruct2025.05 | 43.4 | |
| MacNetBackbone=Qwen-2.5-72B-Instruct2025.05 | 42.4 | |
| ATLAS (RL)Evaluation Protocol=Out-of-Distribution2026.01 | 42 | |
| AutoGenBackbone=Llama-3.3-70B-Instruct2025.05 | 41.9 | |
| ReasonAnyBackbone=Qwen2.5-7B family2026.01 | 41.06 | |
| FinanceBackbone=Qwen2.5-7B family2026.01 | 39.39 | |
| LinearBackbone=Qwen2.5-7B family2026.01 | 39.39 | |
| RouterDCEvaluation Protocol=In-Distribution2026.01 | 39.1 | |
| LEDBackbone=Qwen2.5-7B family2026.01 | 38.64 | |
| BertRouterEvaluation Protocol=In-Distribution2026.01 | 36.6 | |
| MLPRouterEvaluation Protocol=In-Distribution2026.01 | 34.8 | |
| Task ArithmeticBackbone=Qwen2.5-7B family2026.01 | 31.82 | |
| Random RouterEvaluation Protocol=Training-free2026.01 | 30.6 | |
| TIESBackbone=Qwen2.5-7B family2026.01 | 29.55 | |
| ATLAS (cluster)Evaluation Protocol=Out-of-Distribution2026.01 | 29 | |
| RouterDCEvaluation Protocol=Out-of-Distribution2026.01 | 28.6 | |
| DAREBackbone=Qwen2.5-7B family2026.01 | 28.03 | |
| BertRouterEvaluation Protocol=Out-of-Distribution2026.01 | 27.7 | |
| MLPRouterEvaluation Protocol=Out-of-Distribution2026.01 | 26.8 | |
| FS RouterEvaluation Protocol=Training-free, Prompting Strategy=Few-shot2026.01 | 25.9 | |
| ZS RouterEvaluation Protocol=Training-free, Prompting Strategy=Zero-shot2026.01 | 24.6 | |
| FuseLLMBackbone=Qwen2.5-7B family2026.01 | 0 |