Conversational Question Answering on CoQA (Overall, Prune)
1.253Overall ScoreReFreeKV
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ReFreeKVBackbone=Llama3-70B-Instruct, k=12025.02 | 1.253 | 0.29 | |
| Llama3 (Full)Backbone=Llama3-70B-Instruct2025.02 | 1.167 | — | |
| SLMBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 1.138 | 0.229 | |
| SnapKVBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 1.116 | 0.241 | |
| H2OBackbone=Llama3-70B-Instruct, ratio=0.52025.02 | 1.059 | 0.24 | |
| ReFreeKVBackbone=Llama3-8B-Instruct, k=12025.02 | 0.331 | 0.033 | |
| SLMBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 0.301 | 0.03 | |
| H2OBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 0.29 | 0.018 | |
| Llama3 (Full)Backbone=Llama3-8B-Instruct2025.02 | 0.289 | — | |
| SnapKVBackbone=Llama3-8B-Instruct, ratio=0.52025.02 | 0.285 | 0.019 |