Code on Long Code Completion
19.31ScoreReFreeKV
Evaluation results
| Method | Links | |
|---|---|---|
| ReFreeKVBackbone=Llama3-8B-Instruct, k=1, Real Budget Utilization=78.0%2025.02 | 19.31 | |
| Full CacheBackbone=Llama3-8B-Instruct2025.02 | 19.16 | |
| Full CacheBackbone=Mistral-7B-Instruct2025.02 | 16.08 | |
| ReFreeKVBackbone=Mistral-7B-Instruct, k=1, Real Budget Utilization=89.4%2025.02 | 15.33 | |
| ReFreeKVBackbone=Qwen2.5-7B-Instruct, k=1, Real Budget Utilization=84.4%2025.02 | 3.58 | |
| Full CacheBackbone=Qwen2.5-7B-Instruct2025.02 | 2.44 |