Mathematical Reasoning on LG-GSM8K (accuracy)
47.33Accuracy (LG-GSM8K)ShotKV
Evaluation results
| Method | Links | |
|---|---|---|
| ShotKVCompression Ratio (%)=40%2025.02 | 47.33 | |
| FullKVCompression Ratio (%)=100%2025.02 | 46 | |
| ShotKVCompression Ratio (%)=35%2025.02 | 41.33 | |
| StreamingLLMCompression Ratio (%)=40%2025.02 | 39.5 | |
| PyramidInferCompression Ratio (%)=40%2025.02 | 38.33 | |
| ShotKVCompression Ratio (%)=30%2025.02 | 38.33 | |
| H2OCompression Ratio (%)=40%2025.02 | 32.66 | |
| StreamingLLMCompression Ratio (%)=35%2025.02 | 28.67 | |
| PyramidInferCompression Ratio (%)=35%2025.02 | 27.67 | |
| ShotKVCompression Ratio (%)=25%2025.02 | 26.83 | |
| H2OCompression Ratio (%)=35%2025.02 | 25.17 | |
| PyramidInferCompression Ratio (%)=30%2025.02 | 20.5 | |
| H2OCompression Ratio (%)=30%2025.02 | 19.83 | |
| PyramidInferCompression Ratio (%)=25%2025.02 | 16.67 | |
| StreamingLLMCompression Ratio (%)=30%2025.02 | 14.83 | |
| H2OCompression Ratio (%)=25%2025.02 | 14.83 | |
| StreamingLLMCompression Ratio (%)=25%2025.02 | 6.33 |