List your company
ResearchFormerly WizWand

Variable Tracking on RULER 4k

81.8F1 ScorePCD
-3.27218.81440.962.986Jun 10, 2025
Updated 8mo ago

Evaluation results

MethodLinks
PCDModel (Max Context)=Llama-3-8B (262k)2025.0681.8
RephrasingModel (Max Context)=Llama-3-8B (262k)2025.0681.6
DoLa-HighModel (Max Context)=Llama-3-8B (262k)2025.0677.19
DoLa-LowModel (Max Context)=Llama-3-8B (262k)2025.0676.48
Beam-SearchModel (Max Context)=Llama-3-8B (262k)2025.0674.34
MsPoEModel (Max Context)=Llama-3-8B (262k)2025.0674.29
BaseModel (Max Context)=Llama-3-8B (262k)2025.0674.02
PCDModel (Max Context)=Llama-3-8B (8k)2025.0668.91
BaseModel (Max Context)=Llama-3-8B (1048k)2025.0667.15
PCDModel (Max Context)=Llama-3-8B (1048k)2025.0666.77
BaseModel (Max Context)=Llama-3-8B (8k)2025.0666.38
SegRModel (Max Context)=Llama-3-8B (262k)2025.060