STEM Reasoning on GPQA (Pass@1)
77.06Pass@1 AccuracyGPT-OSS-120B
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-OSS-120BSampling Strategy=4-sample mean2026.04 | 77.06 | |
| GPT-5 MiniSampling Strategy=4-sample mean2026.04 | 75.46 | |
| Gemini 2.5 FlashSampling Strategy=4-sample mean2026.04 | 75.09 | |
| Aryabhata 2Sampling Strategy=4-sample mean2026.04 | 74.86 | |
| Qwen3-30B-A3B (Thinking)Sampling Strategy=4-sample mean2026.04 | 73.31 | |
| GPT-OSS-20BSampling Strategy=4-sample mean2026.04 | 70.51 | |
| Nemotron 3 Nano 30B A3BSampling Strategy=4-sample mean2026.04 | 65.38 | |
| GPT-5 NanoSampling Strategy=4-sample mean2026.04 | 61.11 | |
| TACBackbone=Qwen3-4B-Base, Seeds=12026.06 | 42.5 | |
| RandomBackbone=Qwen3-4B-Base, Seeds=12026.06 | 41.3 | |
| SECBackbone=Qwen3-4B-Base, Seeds=12026.06 | 36.7 | |
| SECBackbone=Qwen3-0.6B-Base, Seeds=12026.06 | 29.5 | |
| RandomBackbone=Qwen3-0.6B-Base, Seeds=12026.06 | 27.7 | |
| TACBackbone=Qwen3-0.6B-Base, Seeds=12026.06 | 27.5 |