Associative Recall on RULER S-NIAH-2 2K
100Recall AccuracyLlama-3.1-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3.1-8BCache Params (η, λ)=(∞, 0)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(512, 512)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(256, 256)2025.05 | 85.4 | |
| LoLCATs-8B+Cache Params (η, λ)=(1024, 0)2025.05 | 60 | |
| LoLCATs-8B+Cache Params (η, λ)=(512, 0)2025.05 | 21.6 | |
| LoLCATs-8B+Cache Params (η, λ)=(128, 0)2025.05 | 7.2 | |
| LoLA-8BCache Params (η, λ)=(64, 64)2025.05 | 3 | |
| LoLCATs-8BCache Params (η, λ)=(64, 0)2025.05 | 2 |