Language Modeling on C4 (Log-PPL)
2.834Log-PPLOriginal
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalBase Model=Qwen-2.5 1.5B2025.07 | 2.834 | |
| RotorBase Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.07 | 2.854 | |
| OriginalBase Model=Fox-1.0 1.6B, Layer replacements=02025.07 | 2.862 | |
| BH1Base Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.07 | 2.865 | |
| LR4Base Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.07 | 2.874 | |
| RotorBase Model=Fox-1.0 1.6B, Layer replacements=12025.07 | 2.877 | |
| BH1Base Model=Fox-1.0 1.6B, Layer replacements=12025.07 | 2.878 | |
| LR4Base Model=Fox-1.0 1.6B, Layer replacements=12025.07 | 2.88 | |
| LR1Base Model=Fox-1.0 1.6B, Layer replacements=12025.07 | 2.881 | |
| LR1Base Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.07 | 2.884 | |
| BH1Base Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.07 | 2.897 | |
| BH1Base Model=Fox-1.0 1.6B, Layer replacements=22025.07 | 2.898 | |
| RotorBase Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.07 | 2.9 | |
| LR4Base Model=Fox-1.0 1.6B, Layer replacements=22025.07 | 2.901 | |
| RotorBase Model=Fox-1.0 1.6B, Layer replacements=22025.07 | 2.901 | |
| LR4Base Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.07 | 2.905 | |
| LR1Base Model=Fox-1.0 1.6B, Layer replacements=22025.07 | 2.907 | |
| LR1Base Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.07 | 2.91 | |
| BH1Base Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.07 | 2.975 | |
| RotorBase Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.07 | 2.977 | |
| LR4Base Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.07 | 2.98 | |
| LR1Base Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.07 | 2.985 | |
| OriginalBase Model=LLaMa-3.2 1B2025.07 | 3.151 | |
| RotorBase Model=LLaMa-3.2 1B, Number of layer replacements=one2025.07 | 3.261 | |
| BH1Base Model=LLaMa-3.2 1B, Number of layer replacements=two2025.07 | 3.262 | |
| RotorBase Model=LLaMa-3.2 1B, Number of layer replacements=two2025.07 | 3.285 | |
| LR4Base Model=LLaMa-3.2 1B, Number of layer replacements=two2025.07 | 3.315 | |
| BH1Base Model=LLaMa-3.2 1B, Number of layer replacements=one2025.07 | 3.343 | |
| LR4Base Model=LLaMa-3.2 1B, Number of layer replacements=one2025.07 | 3.39 | |
| BH1Base Model=LLaMa-3.2 1B, Number of layer replacements=three2025.07 | 3.404 | |
| LR1Base Model=LLaMa-3.2 1B, Number of layer replacements=one2025.07 | 3.414 | |
| RotorBase Model=LLaMa-3.2 1B, Number of layer replacements=three2025.07 | 3.428 | |
| LR4Base Model=LLaMa-3.2 1B, Number of layer replacements=three2025.07 | 3.504 | |
| LR1Base Model=LLaMa-3.2 1B, Number of layer replacements=two2025.07 | 4.071 | |
| LR1Base Model=LLaMa-3.2 1B, Number of layer replacements=three2025.07 | 5.001 |