Language Modeling on Code
5.5PerplexitySpectrumKV
Evaluation results
| Method | Links | |
|---|---|---|
| SpectrumKVModel=Qwen2.5-7B, Budget (b)=0.52026.06 | 5.5 | |
| SpectrumKVModel=Mistral-7B, Budget (b)=0.52026.06 | 6.9 | |
| SpectrumKVModel=Gemma-2-9B, Budget (b)=0.52026.06 | 8 | |
| PDTrimModel=Qwen2.5-7B, Budget (b)=0.52026.06 | 8.1 | |
| PDTrimModel=Gemma-2-9B, Budget (b)=0.52026.06 | 11.4 | |
| PDTrimModel=Mistral-7B, Budget (b)=0.52026.06 | 15.7 |