Mathematical Reasoning on SVAMP (Reusability Score)
71.11Reusability ScoreLlama
Evaluation results
| Method | Links | |
|---|---|---|
| LlamaExecutor=Strong Comm.2026.02 | 71.11 | |
| LlamaExecutor=Full Comm.2026.02 | 65.43 | |
| LlamaExecutor=Weak Comm.2026.02 | 59.75 | |
| PhiExecutor=Strong Comm.2026.02 | 59.56 | |
| GemmaExecutor=Strong Comm.2026.02 | 56.9 | |
| R1Executor=Strong Comm.2026.02 | 45.76 | |
| PhiExecutor=Full Comm.2026.02 | 43.69 | |
| GemmaExecutor=Full Comm.2026.02 | 39.14 | |
| R1Executor=Full Comm.2026.02 | 33.79 | |
| PhiExecutor=Weak Comm.2026.02 | 27.82 | |
| R1Executor=Weak Comm.2026.02 | 21.83 | |
| GemmaExecutor=Weak Comm.2026.02 | 21.37 |