Mathematical Reasoning on GSM8K (Overall, Prune)
22.079Overall AccuracySLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SLMBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 22.079 | 15 | |
| H2OBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 19.062 | 11.4 | |
| Llama3 (Full)Backbone=Llama3-70B-Instruct2025.02 | 17.504 | — | |
| SnapKVBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 16.517 | 11.7 | |
| ReFreeKVBackbone=Llama3-70B-Instruct, k=12025.02 | 15.975 | 15.4 | |
| SLMBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 6.071 | 0.6 | |
| SnapKVBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 5.874 | 2.1 | |
| Llama3 (Full)Backbone=Llama3-8B-Instruct2025.02 | 4.693 | — | |
| H2OBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 4.686 | 2 | |
| ReFreeKVBackbone=Llama3-8B-Instruct, k=12025.02 | 4.638 | 3.4 |