Completion Length Prediction on Countdown (eval)
5.27MAECompletion Length Probe
Evaluation results
| Method | Links | |
|---|---|---|
| Completion Length ProbeModel=Llama-3.1-8B2026.07 | 5.27 | |
| Completion Length ProbeModel=Olmo-3-7B2026.07 | 8.4 | |
| Completion Length ProbeModel=Mistral-7B2026.07 | 35.92 | |
| Statistical baselineModel=Llama-3.1-8B2026.07 | 150.18 | |
| Statistical baselineModel=Olmo-3-7B2026.07 | 150.58 | |
| Statistical baselineModel=Mistral-7B2026.07 | 265.12 |