Science Reasoning on GPQA (GPQA Metric)
69.4GPQA ScoreLocal Highest
Evaluation Results
| Method | Links | |
|---|---|---|
| Local HighestStudent Model=Qwen2.5-32B-Instruct, Selection Strategy=Local average log probabilities2025.10 | 69.4 | |
| OpenThinker2-32BStudent Model=Qwen2.5-32B-Instruct2025.10 | 64.6 | |
| LIMO-32BStudent Model=Qwen2.5-32B-Instruct2025.10 | 62.6 | |
| Global HighestStudent Model=Qwen2.5-32B-Instruct, Selection Strategy=Global average log probabilities2025.10 | 61.1 | |
| Sky-T1-32B-PreviewStudent Model=Qwen2.5-32B-Instruct2025.10 | 56.6 | |
| Original ModelStudent Model=Qwen2.5-32B-Instruct2025.10 | 55.1 | |
| Granite-3.3MT=MCS, RL=MC2026.03 | 52.86 | |
| Granite-3.3MT=MCS, RL=MCS2026.03 | 51.52 | |
| Mistral-7BMT=MCS, RL=MCS2026.03 | 41.75 | |
| Mistral-7BMT=MCS, RL=MC2026.03 | 40.91 | |
| LLaMA-3.1MT=MCS, RL=MCS2026.03 | 36.03 | |
| Granite-3.3MT=MC, RL=MCS2026.03 | 35.69 | |
| Granite-3.3MT=MC, RL=MC2026.03 | 35.52 | |
| LLaMA-3.1MT=MCS, RL=MC2026.03 | 34.01 | |
| Granite-3.3MT=MCS, RL=–2026.03 | 29.12 | |
| Mistral-7BMT=MC, RL=MC2026.03 | 29.12 | |
| Mistral-7BMT=MC, RL=MCS2026.03 | 28.28 | |
| Mistral-7BMT=–, RL=–2026.03 | 26.94 | |
| LLaMA-3.1MT=MC, RL=MCS2026.03 | 24.75 | |
| Mistral-7BMT=MCS, RL=–2026.03 | 24.07 | |
| LLaMA-3.1MT=MC, RL=MC2026.03 | 23.06 | |
| Granite-3.3MT=–, RL=–2026.03 | 22.56 | |
| LLaMA-3.1MT=MCS, RL=–2026.03 | 21.04 | |
| LLaMA-3.1MT=–, RL=–2026.03 | 20.2 | |
| LLaMA-3.1MT=MC, RL=–2026.03 | 19.53 | |
| Granite-3.3MT=MC, RL=–2026.03 | 19.02 | |
| Mistral-7BMT=MC, RL=–2026.03 | 15.99 |