Long-context Retrieval on Needle-in-a-Haystack (NiH)
100Accuracy (512 tokens)Dense
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DensePrune%=0%, Base Model=LLaMA-2-13B2025.12 | 100 | 100 | 90 | 95 | 45 | 35 | |
| Token FilteringPrune%=20%, Base Model=LLaMA-2-13B2025.12 | 70 | 70 | 65 | 55 | 30 | 10 | |
| FLAPPrune%=20%, Base Model=LLaMA-2-13B2025.12 | 25 | 20 | 10 | 0 | 0 | 0 |