Variable Tracking on RULER 4k
81.8F1 ScorePCD
Evaluation Results
| Method | Links | |
|---|---|---|
| PCDModel (Max Context)=Llama-3-8B (262k)2025.06 | 81.8 | |
| RephrasingModel (Max Context)=Llama-3-8B (262k)2025.06 | 81.6 | |
| DoLa-HighModel (Max Context)=Llama-3-8B (262k)2025.06 | 77.19 | |
| DoLa-LowModel (Max Context)=Llama-3-8B (262k)2025.06 | 76.48 | |
| Beam-SearchModel (Max Context)=Llama-3-8B (262k)2025.06 | 74.34 | |
| MsPoEModel (Max Context)=Llama-3-8B (262k)2025.06 | 74.29 | |
| BaseModel (Max Context)=Llama-3-8B (262k)2025.06 | 74.02 | |
| PCDModel (Max Context)=Llama-3-8B (8k)2025.06 | 68.91 | |
| BaseModel (Max Context)=Llama-3-8B (1048k)2025.06 | 67.15 | |
| PCDModel (Max Context)=Llama-3-8B (1048k)2025.06 | 66.77 | |
| BaseModel (Max Context)=Llama-3-8B (8k)2025.06 | 66.38 | |
| SegRModel (Max Context)=Llama-3-8B (262k)2025.06 | 0 |