Long-context QA on RULER 1200 (test)
84.1Success RateCVT-RL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CVT-RLDescription=per-seed CVT-RL success, Split (train/dev/test)=7200/900/1200, Individual Seeds=83.6/84.7/82.9/84.4/84.82026.06 | 84.1 | 4.7 | |
| IMDescription=information-matched counterfactual-process RL, Split (train/dev/test)=7200/900/12002026.06 | 79.4 | — | |
| CMDescription=compute-matched non-causal RL, Split (train/dev/test)=7200/900/12002026.06 | 76.4 | — |