Mathematical Reasoning on AIME (Accuracy, Delta, Pct. gap closed)
94.8AccuracyLoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LoRAModel=GPT-OSS-20B, Calibration set=MATH-5002026.04 | 94.8 | — | — | |
| SCATR-WMVModel=GPT-OSS-20B, Calibration set=MATH-5002026.04 | 94 | — | — | |
| Best Confidence-based StrategyModel=GPT-OSS-20B, Calibration set=MATH-5002026.04 | 93.3 | — | — | |
| PRMModel=GPT-OSS-20B, Calibration set=MATH-5002026.04 | 92.2 | — | — | |
| SCATRModel=GPT-OSS-20B, Calibration set=MATH-5002026.04 | 89.8 | -3.5 | -77.8 | |
| BDR-64Model=GLM-4.7 (358B)2026.04 | 81.11 | — | — | |
| BF16Model=GLM-4.7 (358B)2026.04 | 80 | — | — | |
| INT4Model=GLM-4.7 (358B)2026.04 | 80 | — | — | |
| BDR-16Model=GLM-4.7 (358B)2026.04 | 78.89 | — | — | |
| BDR-128Model=GLM-4.7 (358B)2026.04 | 78.89 | — | — | |
| BF16Model=Qwen3-8B2026.04 | 70 | — | — | |
| BDR-128Model=Qwen3-8B2026.04 | 68 | — | — | |
| BDR-64 (K)Model=Qwen3-8B2026.04 | 66 | — | — | |
| BDR-64Model=Qwen3-8B2026.04 | 64 | — | — | |
| BDR-16Model=Qwen3-8B2026.04 | 59.33 | — | — | |
| SCATR-WMVModel=Qwen-1.7B, Calibration set=MATH-5002026.04 | 55.2 | — | — | |
| Best Confidence-based StrategyModel=Qwen-1.7B, Calibration set=MATH-5002026.04 | 52.2 | — | — | |
| LoRAModel=Qwen-1.7B, Calibration set=MATH-5002026.04 | 50.4 | — | — | |
| SCATRModel=Qwen-1.7B, Calibration set=MATH-5002026.04 | 48.9 | -3.3 | -19.8 | |
| SCATR-WMVModel=Qwen-30B-A3B, Calibration set=MATH-5002026.04 | 45.7 | — | — | |
| SCATRModel=Qwen-30B-A3B, Calibration set=MATH-5002026.04 | 42.4 | 9.1 | 37.1 | |
| PRMModel=Qwen-1.7B, Calibration set=MATH-5002026.04 | 41.1 | — | — | |
| PRMModel=Qwen-30B-A3B, Calibration set=MATH-5002026.04 | 37.8 | — | — | |
| Best Confidence-based StrategyModel=Qwen-30B-A3B, Calibration set=MATH-5002026.04 | 33.3 | — | — | |
| COACTTrained on=GSM8K2026.04 | 6.67 | — | — | |
| RandomTrained on=GSM8K2026.04 | 3.33 | — | — | |
| EntropyTrained on=GSM8K2026.04 | 3.33 | — | — | |
| Pref + EntTrained on=GSM8K2026.04 | 3.33 | — | — | |
| EntropyTrained on=WebInstruct, Evaluation=Out-of-domain2026.04 | 3.33 | — | — | |
| Pref CertaintyTrained on=WebInstruct, Evaluation=Out-of-domain2026.04 | 3.33 | — | — | |
| Pref CertaintyTrained on=GSM8K2026.04 | 2.22 | — | — | |
| Pref + EntTrained on=WebInstruct, Evaluation=Out-of-domain2026.04 | 2.22 | — | — | |
| COACTTrained on=WebInstruct, Evaluation=Out-of-domain2026.04 | 2.22 | — | — | |
| RandomTrained on=WebInstruct, Evaluation=Out-of-domain2026.04 | 0 | — | — | |
| INT4Model=Qwen3-8B2026.04 | 0 | — | — |