Question Answering on Babilong 64k context length
25QA1 ScoreLASER-KV
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LASER-KVContext Length=64k, Backbone=Llama-3.1-8b-Instruct, Variant=Exact+MP(0.75)2026.02 | 25 | 9 | 31 | 87 | 48 | |
| Full AttentionContext Length=64k, Backbone=Llama-3.1-8b-Instruct2026.02 | 24 | 6 | 21 | 72 | 51 | |
| FINCHContext Length=64k, Backbone=Llama-3.1-8b-Instruct2026.02 | 22 | 8 | 13 | 44 | 45 | |
| PyramidKVContext Length=64k, Backbone=Llama-3.1-8b-Instruct2026.02 | 16 | 13 | 25 | 72 | 70 | |
| SnapKVContext Length=64k, Backbone=Llama-3.1-8b-Instruct2026.02 | 7 | 1 | 15 | 51 | 36 |