Associative Recall on RULER S-NIAH-3 2K context
100Recall AccuracyLlama-3.1-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3.1-8BCache Params (η, λ)=(∞, 0)2025.05 | 100 | |
| LoLA-8BCache Params (η, λ)=(512, 512)2025.05 | 100 | |
| LoLCATs-8B+Cache Params (η, λ)=(1024, 0)2025.05 | 27.6 | |
| LoLA-8BCache Params (η, λ)=(256, 256)2025.05 | 27.2 | |
| LoLCATs-8B+Cache Params (η, λ)=(512, 0)2025.05 | 10.6 | |
| LoLCATs-8B+Cache Params (η, λ)=(128, 0)2025.05 | 3.2 | |
| LoLA-8BCache Params (η, λ)=(64, 64)2025.05 | 1.6 | |
| LoLCATs-8BCache Params (η, λ)=(64, 0)2025.05 | 0.6 |