List your company
ResearchFormerly WizWand

Language Modeling on C4 (Log-PPL)

2.834Log-PPLOriginal
2.747323.332413.91754.50259Jul 15, 2025
Updated 8mo ago

Evaluation results

MethodLinks
OriginalBase Model=Qwen-2.5 1.5B2025.072.834
RotorBase Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.072.854
OriginalBase Model=Fox-1.0 1.6B, Layer replacements=02025.072.862
BH1Base Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.072.865
LR4Base Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.072.874
RotorBase Model=Fox-1.0 1.6B, Layer replacements=12025.072.877
BH1Base Model=Fox-1.0 1.6B, Layer replacements=12025.072.878
LR4Base Model=Fox-1.0 1.6B, Layer replacements=12025.072.88
LR1Base Model=Fox-1.0 1.6B, Layer replacements=12025.072.881
LR1Base Model=Qwen-2.5 1.5B, Number of layer replacements=one2025.072.884
BH1Base Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.072.897
BH1Base Model=Fox-1.0 1.6B, Layer replacements=22025.072.898
RotorBase Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.072.9
LR4Base Model=Fox-1.0 1.6B, Layer replacements=22025.072.901
RotorBase Model=Fox-1.0 1.6B, Layer replacements=22025.072.901
LR4Base Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.072.905
LR1Base Model=Fox-1.0 1.6B, Layer replacements=22025.072.907
LR1Base Model=Qwen-2.5 1.5B, Number of layer replacements=two2025.072.91
BH1Base Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.072.975
RotorBase Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.072.977
LR4Base Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.072.98
LR1Base Model=Qwen-2.5 1.5B, Number of layer replacements=three2025.072.985
OriginalBase Model=LLaMa-3.2 1B2025.073.151
RotorBase Model=LLaMa-3.2 1B, Number of layer replacements=one2025.073.261
BH1Base Model=LLaMa-3.2 1B, Number of layer replacements=two2025.073.262
RotorBase Model=LLaMa-3.2 1B, Number of layer replacements=two2025.073.285
LR4Base Model=LLaMa-3.2 1B, Number of layer replacements=two2025.073.315
BH1Base Model=LLaMa-3.2 1B, Number of layer replacements=one2025.073.343
LR4Base Model=LLaMa-3.2 1B, Number of layer replacements=one2025.073.39
BH1Base Model=LLaMa-3.2 1B, Number of layer replacements=three2025.073.404
LR1Base Model=LLaMa-3.2 1B, Number of layer replacements=one2025.073.414
RotorBase Model=LLaMa-3.2 1B, Number of layer replacements=three2025.073.428
LR4Base Model=LLaMa-3.2 1B, Number of layer replacements=three2025.073.504
LR1Base Model=LLaMa-3.2 1B, Number of layer replacements=two2025.074.071
LR1Base Model=LLaMa-3.2 1B, Number of layer replacements=three2025.075.001