Next-token prediction on blocksworld 8b (train)
100AccuracyStick-Breaking Transformer
Evaluation results
| Method | Links | |
|---|---|---|
| Stick-Breaking Transformerencoding=init-atoms2025.09 | 100 | |
| RoPEencoding=init-atoms2025.09 | 99.8 | |
| Sinusoidalencoding=init-atoms2025.09 | 99.4 |