Language Modeling on WikiText-103 v1 (test)
10.48PerplexityClean
Evaluation Results
| Method | Links | |
|---|---|---|
| CleanBackbone=OLMoE, Temperature=25°C2026.05 | 10.48 | |
| CleanBackbone=OLMoE, Temperature=80°C2026.05 | 10.48 | |
| CleanBackbone=DeepSeek, Temperature=25°C2026.05 | 10.64 | |
| CleanBackbone=DeepSeek, Temperature=80°C2026.05 | 10.64 | |
| ROMERBackbone=OLMoE, Temperature=25°C2026.05 | 10.82 | |
| CleanBackbone=Qwen1.5, Temperature=25°C2026.05 | 10.85 | |
| CleanBackbone=Qwen1.5, Temperature=80°C2026.05 | 10.85 | |
| Bit-slicingBackbone=OLMoE, Temperature=25°C2026.05 | 10.86 | |
| ROMERBackbone=DeepSeek, Temperature=25°C2026.05 | 10.86 | |
| ROMERBackbone=Qwen1.5, Temperature=25°C2026.05 | 10.9 | |
| Bit-slicingBackbone=Qwen1.5, Temperature=25°C2026.05 | 10.93 | |
| Weight-remappingBackbone=Qwen1.5, Temperature=25°C2026.05 | 10.93 | |
| Weight-remappingBackbone=DeepSeek, Temperature=25°C2026.05 | 10.95 | |
| Weight-remappingBackbone=OLMoE, Temperature=25°C2026.05 | 10.96 | |
| k-b calibrationBackbone=Qwen1.5, Temperature=25°C2026.05 | 10.97 | |
| VanillaBackbone=Qwen1.5, Temperature=25°C2026.05 | 11 | |
| AverageBackbone=OLMoE, Temperature=25°C2026.05 | 11.07 | |
| AverageBackbone=Qwen1.5, Temperature=25°C2026.05 | 11.09 | |
| AverageBackbone=DeepSeek, Temperature=25°C2026.05 | 11.13 | |
| k-b calibrationBackbone=DeepSeek, Temperature=25°C2026.05 | 11.13 | |
| ROMERBackbone=Qwen1.5, Temperature=80°C2026.05 | 11.16 | |
| VanillaBackbone=DeepSeek, Temperature=25°C2026.05 | 11.25 | |
| k-b calibrationBackbone=OLMoE, Temperature=25°C2026.05 | 11.25 | |
| Weight-remappingBackbone=Qwen1.5, Temperature=80°C2026.05 | 11.29 | |
| ROMERBackbone=DeepSeek, Temperature=80°C2026.05 | 11.31 | |
| ROMERBackbone=OLMoE, Temperature=80°C2026.05 | 11.43 | |
| VanillaBackbone=OLMoE, Temperature=25°C2026.05 | 11.45 | |
| k-b calibrationBackbone=Qwen1.5, Temperature=80°C2026.05 | 11.55 | |
| Weight-remappingBackbone=DeepSeek, Temperature=80°C2026.05 | 11.58 | |
| Bit-slicingBackbone=Qwen1.5, Temperature=80°C2026.05 | 11.59 | |
| VanillaBackbone=Qwen1.5, Temperature=80°C2026.05 | 11.72 | |
| Bit-slicingBackbone=DeepSeek, Temperature=80°C2026.05 | 11.78 | |
| Weight-remappingBackbone=OLMoE, Temperature=80°C2026.05 | 11.82 | |
| AverageBackbone=Qwen1.5, Temperature=80°C2026.05 | 11.95 | |
| k-b calibrationBackbone=DeepSeek, Temperature=80°C2026.05 | 12.13 | |
| AverageBackbone=DeepSeek, Temperature=80°C2026.05 | 12.47 | |
| VanillaBackbone=DeepSeek, Temperature=80°C2026.05 | 12.49 | |
| Bit-slicingBackbone=DeepSeek, Temperature=25°C2026.05 | 12.54 | |
| k-b calibrationBackbone=OLMoE, Temperature=80°C2026.05 | 12.6 | |
| AverageBackbone=OLMoE, Temperature=80°C2026.05 | 12.9 | |
| VanillaBackbone=OLMoE, Temperature=80°C2026.05 | 13.13 | |
| Bit-slicingBackbone=OLMoE, Temperature=80°C2026.05 | 14.62 | |
| CleanBackbone=Qwen3, Temperature=25°C2026.05 | 14.87 | |
| CleanBackbone=Qwen3, Temperature=80°C2026.05 | 14.87 | |
| ROMERBackbone=Qwen3, Temperature=25°C2026.05 | 14.97 | |
| Weight-remappingBackbone=Qwen3, Temperature=25°C2026.05 | 15.02 | |
| k-b calibrationBackbone=Qwen3, Temperature=25°C2026.05 | 15.11 | |
| VanillaBackbone=Qwen3, Temperature=25°C2026.05 | 15.16 | |
| ROMERBackbone=Qwen3, Temperature=80°C2026.05 | 15.32 | |
| AverageBackbone=Qwen3, Temperature=80°C2026.05 | 15.44 | |
| Weight-remappingBackbone=Qwen3, Temperature=80°C2026.05 | 15.51 | |
| AverageBackbone=Qwen3, Temperature=25°C2026.05 | 15.64 | |
| k-b calibrationBackbone=Qwen3, Temperature=80°C2026.05 | 15.89 | |
| VanillaBackbone=Qwen3, Temperature=80°C2026.05 | 16.14 | |
| Bit-slicingBackbone=Qwen3, Temperature=25°C2026.05 | 16.52 | |
| Bit-slicingBackbone=Qwen3, Temperature=80°C2026.05 | 17.58 |