Reading Comprehension on TriviaQA (Overall, Prune)
5.576Overall ScoreSLM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SLMBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 5.576 | 1.367 | |
| H2OBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 5.566 | 1.308 | |
| SnapKVBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 5.562 | 1.083 | |
| Llama3 (Full)Backbone=Llama3-70B-Instruct2025.02 | 5.302 | — | |
| ReFreeKVBackbone=Llama3-70B-Instruct, k=12025.02 | 5.224 | 1.602 | |
| Llama3 (Full)Backbone=Llama3-8B-Instruct2025.02 | 2.717 | — | |
| ReFreeKVBackbone=Llama3-8B-Instruct, k=12025.02 | 2.684 | 0.211 | |
| SnapKVBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 2.65 | 0.265 | |
| SLMBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 2.628 | 0.208 | |
| H2OBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 2.612 | 0.237 |