Associative Recall on RULER S-NIAH-2 (1K context)
100Recall AccuracyLlama-3.1-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3.1-8BCache Params (η, λ)=(∞, 0)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(256, 256)2025.05 | 100 | |
| LoLCATs-8B+Cache Params (η, λ)=(1024, 0)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(512, 512)2025.05 | 100 | |
| LoLCATs-8B+Cache Params (η, λ)=(512, 0)2025.05 | 71.8 | |
| LoLA-8BCache Params (η, λ)=(64, 64)2025.05 | 39.4 | |
| LoLCATs-8B+Cache Params (η, λ)=(128, 0)2025.05 | 17.4 | |
| LoLCATs-8BCache Params (η, λ)=(64, 0)2025.05 | 7.6 |