Math Reasoning on MATH 500 (pass@4, Average)
87.8Success Rate (pass@4)LLM-KD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLM-KDBackbone=Qwen2.5-7B2026.04 | 87.8 | 63.54 | |
| JURY-RLBackbone=Qwen2.5-7B2026.04 | 86.6 | 64.04 | |
| Majority-VotingBackbone=Qwen2.5-7B2026.04 | 85.4 | 61.52 | |
| GT-RewardBackbone=Qwen2.5-7B2026.04 | 85.2 | 62.48 | |
| EntropyBackbone=Qwen2.5-7B2026.04 | 85.2 | 62.62 | |
| Self-CertaintyBackbone=Qwen2.5-7B2026.04 | 84.6 | 60.33 | |
| CoRewardBackbone=Qwen2.5-7B2026.04 | 83.8 | 59.99 | |
| LLM-KDBackbone=Qwen3-1.7B-Base2026.04 | 82.2 | 53.51 | |
| LLM-as-a-JudgeBackbone=Qwen2.5-7B2026.04 | 82.2 | 53.99 | |
| GT-RewardBackbone=Qwen3-1.7B-Base2026.04 | 82 | 55.36 | |
| JURY-RLBackbone=Qwen3-1.7B-Base2026.04 | 82 | 59.41 | |
| EntropyBackbone=Qwen3-1.7B-Base2026.04 | 81.2 | 54.86 | |
| CoRewardBackbone=Qwen3-1.7B-Base2026.04 | 77.4 | 53.4 | |
| Self-CertaintyBackbone=Qwen3-1.7B-Base2026.04 | 77.2 | 55.17 | |
| Majority-VotingBackbone=Qwen3-1.7B-Base2026.04 | 77.2 | 52.51 | |
| Before RLBackbone=Qwen2.5-7B2026.04 | 76.2 | 56.77 | |
| LLM-as-a-JudgeBackbone=Qwen3-1.7B-Base2026.04 | 74.6 | 50.35 | |
| Before RLBackbone=Qwen3-1.7B-Base2026.04 | 72 | 49.59 | |
| Before RLBackbone=Llama-3.2-3B-Instruct2026.04 | 65 | 46.26 | |
| LLM-KDBackbone=Llama-3.2-3B-Instruct2026.04 | 65 | 46.21 | |
| JURY-RLBackbone=Llama-3.2-3B-Instruct2026.04 | 64.8 | 48.48 | |
| GT-RewardBackbone=Llama-3.2-3B-Instruct2026.04 | 63.8 | 45.46 | |
| Majority-VotingBackbone=Llama-3.2-3B-Instruct2026.04 | 63.6 | 42.2 | |
| LLM-as-a-JudgeBackbone=Llama-3.2-3B-Instruct2026.04 | 62.2 | 45.93 | |
| CoRewardBackbone=Llama-3.2-3B-Instruct2026.04 | 60.4 | 43.51 | |
| EntropyBackbone=Llama-3.2-3B-Instruct2026.04 | 58.8 | 42.77 | |
| Self-CertaintyBackbone=Llama-3.2-3B-Instruct2026.04 | 58 | 42.12 |