Math Reasoning on AMC (pass@8, Average)
71.08Pass@8JURY-RL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| JURY-RLBackbone=Qwen2.5-7B2026.04 | 71.08 | 64.04 | |
| Self-CertaintyBackbone=Qwen2.5-7B2026.04 | 69.88 | 60.33 | |
| GT-RewardBackbone=Qwen2.5-7B2026.04 | 68.67 | 62.48 | |
| LLM-KDBackbone=Qwen2.5-7B2026.04 | 67.47 | 63.54 | |
| EntropyBackbone=Qwen2.5-7B2026.04 | 67.47 | 62.62 | |
| Before RLBackbone=Qwen2.5-7B2026.04 | 63.86 | 56.77 | |
| Majority-VotingBackbone=Qwen2.5-7B2026.04 | 63.86 | 61.52 | |
| CoRewardBackbone=Qwen2.5-7B2026.04 | 63.86 | 59.99 | |
| JURY-RLBackbone=Qwen3-1.7B-Base2026.04 | 62.65 | 59.41 | |
| GT-RewardBackbone=Qwen3-1.7B-Base2026.04 | 59.04 | 55.36 | |
| EntropyBackbone=Qwen3-1.7B-Base2026.04 | 59.04 | 54.86 | |
| LLM-as-a-JudgeBackbone=Qwen2.5-7B2026.04 | 59.04 | 53.99 | |
| Self-CertaintyBackbone=Qwen3-1.7B-Base2026.04 | 57.83 | 55.17 | |
| Before RLBackbone=Qwen3-1.7B-Base2026.04 | 56.63 | 49.59 | |
| LLM-KDBackbone=Qwen3-1.7B-Base2026.04 | 55.42 | 53.51 | |
| LLM-as-a-JudgeBackbone=Qwen3-1.7B-Base2026.04 | 55.42 | 50.35 | |
| CoRewardBackbone=Qwen3-1.7B-Base2026.04 | 54.22 | 53.4 | |
| JURY-RLBackbone=Llama-3.2-3B-Instruct2026.04 | 54.22 | 48.48 | |
| Majority-VotingBackbone=Qwen3-1.7B-Base2026.04 | 53.01 | 52.51 | |
| EntropyBackbone=Llama-3.2-3B-Instruct2026.04 | 50.6 | 42.77 | |
| Before RLBackbone=Llama-3.2-3B-Instruct2026.04 | 49.4 | 46.26 | |
| LLM-KDBackbone=Llama-3.2-3B-Instruct2026.04 | 49.4 | 46.21 | |
| Self-CertaintyBackbone=Llama-3.2-3B-Instruct2026.04 | 44.58 | 42.12 | |
| GT-RewardBackbone=Llama-3.2-3B-Instruct2026.04 | 43.37 | 45.46 | |
| CoRewardBackbone=Llama-3.2-3B-Instruct2026.04 | 43.37 | 43.51 | |
| LLM-as-a-JudgeBackbone=Llama-3.2-3B-Instruct2026.04 | 40.96 | 45.93 | |
| Majority-VotingBackbone=Llama-3.2-3B-Instruct2026.04 | 39.76 | 42.2 |