Language Modeling on Science
30.5PerplexitySpectrumKV
Evaluation results
| Method | Links | |
|---|---|---|
| SpectrumKVModel=Qwen2.5-7B, Budget (b)=0.52026.06 | 30.5 | |
| SpectrumKVModel=Gemma-2-9B, Budget (b)=0.52026.06 | 32.7 | |
| SpectrumKVModel=Mistral-7B, Budget (b)=0.52026.06 | 33.9 | |
| PDTrimModel=Qwen2.5-7B, Budget (b)=0.52026.06 | 35.4 | |
| PDTrimModel=Gemma-2-9B, Budget (b)=0.52026.06 | 36 | |
| PDTrimModel=Mistral-7B, Budget (b)=0.52026.06 | 152.8 |