Linguistic Acceptability on BLiMP
82.03AccuracyPoPE
Evaluation results
| Method | Links | |
|---|---|---|
| PoPEModel size=774M, Zero-shot=true, Pre-training dataset=OpenWebText2025.09 | 82.03 | |
| RoPEModel size=774M, Zero-shot=true, Pre-training dataset=OpenWebText2025.09 | 81.05 | |
| PoPEModel size=253M, Zero-shot=true, Pre-training dataset=OpenWebText2025.09 | 80.01 | |
| RoPEModel size=253M, Zero-shot=true, Pre-training dataset=OpenWebText2025.09 | 79.12 | |
| PoPEModel size=124M, Zero-shot=true, Pre-training dataset=OpenWebText2025.09 | 77.75 | |
| RoPEModel size=124M, Zero-shot=true, Pre-training dataset=OpenWebText2025.09 | 77.55 |