Long-context Evaluation on RULER (CWE Metric)
1.23Context Window Error (CWE)Random
Evaluation Results
| Method | Links | |
|---|---|---|
| RandomTarget Model=Pythia-1B, Scorer=32B, Selection Size=Top-5K2026.04 | 1.23 | |
| Embed SimTarget Model=Pythia-1B, Scorer=32B, Selection Size=Top-5K2026.04 | 1.8 | |
| Base ModelTarget Model=Pythia-1B2026.04 | 2.14 | |
| BM25Target Model=Pythia-1B, Scorer=32B, Selection Size=Top-5K2026.04 | 2.34 | |
| TrackStarTarget Model=Pythia-1B, Scorer=32B, Selection Size=Top-5K2026.04 | 2.54 | |
| RISETarget Model=Pythia-1B, Scorer=32B, Selection Size=Top-5K2026.04 | 4.1 |