Associative Recall on RULER S-NIAH-3 (1K context)
100Recall AccuracyLlama-3.1-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3.1-8BCache Params (η, λ)=(∞, 0)2025.05 | 100 | |
| LoLCATs-8B+Cache Params (η, λ)=(1024, 0)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(512, 512)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(256, 256)2025.05 | 99.8 | |
| LoLCATs-8B+Cache Params (η, λ)=(512, 0)2025.05 | 66 | |
| LoLCATs-8B+Cache Params (η, λ)=(128, 0)2025.05 | 14.6 | |
| LoLA-8BCache Params (η, λ)=(64, 64)2025.05 | 7.4 | |
| LoLCATs-8BCache Params (η, λ)=(64, 0)2025.05 | 1.6 |