Mathematical Reasoning on SVAMP (Verifiability Score)
97.33Verifiability ScorePhi
Evaluation Results
| Method | Links | |
|---|---|---|
| PhiExecutor=Strong Comm.2026.02 | 97.33 | |
| R1Executor=Strong Comm.2026.02 | 91.33 | |
| PhiExecutor=Full Comm.2026.02 | 89.13 | |
| GemmaExecutor=Strong Comm.2026.02 | 86.93 | |
| LlamaExecutor=Strong Comm.2026.02 | 80.93 | |
| PhiExecutor=Weak Comm.2026.02 | 80.93 | |
| R1Executor=Full Comm.2026.02 | 80.33 | |
| GemmaExecutor=Full Comm.2026.02 | 78.57 | |
| LlamaExecutor=Full Comm.2026.02 | 71.97 | |
| GemmaExecutor=Weak Comm.2026.02 | 70.2 | |
| R1Executor=Weak Comm.2026.02 | 69.33 | |
| LlamaExecutor=Weak Comm.2026.02 | 63 |