Language Understanding on MMLU (pass@1 and pass@128)
74Pass@1Base
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BaseBackbone=Qwen2.5-7B, Generation budget=4096 tokens2026.04 | 74 | 91 | |
| GRPO (Countdown)Backbone=Qwen2.5-7B, Generation budget=4096 tokens, Optimization=GRPO2026.04 | 74 | 92 | |
| Countdown (A') + GRPOBackbone=Qwen2.5-7B, Generation budget=4096 tokens, Training Data=Self-revised answers (A'), Optimization=GRPO2026.04 | 72 | 97 | |
| Countdown (A) + GRPOBackbone=Qwen2.5-7B, Generation budget=4096 tokens, Training Data=LLaMA-70B teacher answers (A), Optimization=GRPO2026.04 | 71 | 97 | |
| Countdown (A')Backbone=Qwen2.5-7B, Generation budget=4096 tokens, Training Data=Self-revised answers (A')2026.04 | 71 | 97 | |
| Countdown (A)Backbone=Qwen2.5-7B, Generation budget=4096 tokens, Training Data=LLaMA-70B teacher answers (A)2026.04 | 69 | 96 |