Question Answering on Babilong 128k context length
38QA1 ScoreLASER-KV
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LASER-KVContext Length=128k, Backbone=Llama-3-8b-Instruct-Gradient-1048k, Variant=Exact+MP(0.75)2026.02 | 38 | 7 | 25 | 84 | 66 | |
| Full AttentionContext Length=128k, Backbone=Llama-3-8b-Instruct-Gradient-1048k2026.02 | 31 | 6 | 15 | 80 | 55 | |
| PyramidKVContext Length=128k, Backbone=Llama-3-8b-Instruct-Gradient-1048k2026.02 | 25 | 10 | 19 | 84 | 59 | |
| SnapKVContext Length=128k, Backbone=Llama-3-8b-Instruct-Gradient-1048k2026.02 | 22 | 5 | 19 | 84 | 57 | |
| FINCHContext Length=128k, Backbone=Llama-3-8b-Instruct-Gradient-1048k2026.02 | 0 | 0 | 0 | 0 | 0 |