Mathematical Reasoning on AIME 24 (Acc, Delta_Up, Delta_Down)
40AccuracyAgentic-Verifier-Qwen3-4B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Agentic-Verifier-Qwen3-4BRefinement Turn=12026.04 | 40 | 26.7 | 3.3 | |
| Agentic-Verifier-Qwen3-4BRefinement Turn=22026.04 | 33.3 | 0 | 6.7 | |
| DS-Distill-14BRefinement Turn=32026.04 | 33 | 6.7 | 0 | |
| Agentic-Verifier-Qwen3-4BRefinement Turn=32026.04 | 33 | 3.3 | 3.3 | |
| DS-Distill-14BRefinement Turn=22026.04 | 26.7 | 3.3 | 0 | |
| Qwen3-4B-ThinkRefinement Turn=32026.04 | 26 | 6.7 | 3 | |
| DS-Distill-14BRefinement Turn=12026.04 | 23.3 | 10 | 0 | |
| Qwen3-4B-ThinkRefinement Turn=22026.04 | 23.3 | 6.7 | 3.3 | |
| Qwen3-4B-ThinkRefinement Turn=12026.04 | 16.7 | 3.3 | 0 | |
| Qwen2.5-7B-InstructRefinement Turn=12026.04 | 13.3 | 0 | 0 | |
| Llama3.1-8B-InstructRefinement Turn=12026.04 | 13.3 | 0 | 0 | |
| Mistral-Small-24B-InstructRefinement Turn=12026.04 | 13.3 | 0 | 0 | |
| Mistral-Small-24B-InstructRefinement Turn=22026.04 | 13.3 | 0 | 0 | |
| Mistral-Small-24B-InstructRefinement Turn=32026.04 | 13 | 0 | 0 | |
| Llama3.1-8B-InstructRefinement Turn=22026.04 | 10 | 0 | 3.3 | |
| Qwen2.5-7B-InstructRefinement Turn=32026.04 | 10 | 6.7 | 3.3 | |
| Qwen2.5-7B-InstructRefinement Turn=22026.04 | 6.7 | 0 | 6.7 | |
| Llama3.1-8B-InstructRefinement Turn=32026.04 | 6 | 0 | 3 |