Language Modeling on LMB
12.4PPLRoPE++EC
Evaluation results
| Method | Links | |
|---|---|---|
| RoPE++ECModel Scale=1.5B, Context Length Setting=Long2025.12 | 12.4 | |
| RoPEModel Scale=1.5B, Context Length Setting=Long2025.12 | 12.5 | |
| RoPE++EHModel Scale=1.5B, Context Length Setting=Long2025.12 | 13 | |
| RoPEModel Scale=1.5B, Context Length Setting=Short2025.12 | 15.3 | |
| RoPE++ECModel Scale=1.5B, Context Length Setting=Short2025.12 | 15.5 | |
| RoPE++EHModel Scale=1.5B, Context Length Setting=Short2025.12 | 16 |