# Language Modeling on C4 (Log-PPL) Source: [Language Modeling on C4 (Log-PPL)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:48:44.069Z Evaluation of language modeling performance on the C4 dataset, specifically reporting Log-Perplexity (Log-PPL). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Language Modeling | | Dataset (including any stated split) | C4 | | Metric | Log-PPL | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 35 of 35 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Log-PPL](): Lower is better; unit: SCALAR. ## Recorded results | Method | Log-PPL | Result date | Report paper | | --- | --- | --- | --- | | Original | 2.834 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 2.854 | Not recorded | 68fa7a1c1e209131cea81406 | | Original | 2.862 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 2.865 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 2.874 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 2.877 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 2.878 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 2.88 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 2.881 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 2.884 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 2.897 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 2.898 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 2.9 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 2.901 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 2.901 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 2.905 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 2.907 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 2.91 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 2.975 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 2.977 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 2.98 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 2.985 | Not recorded | 68fa7a1c1e209131cea81406 | | Original | 3.151 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 3.261 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 3.262 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 3.285 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 3.315 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 3.343 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 3.39 | Not recorded | 68fa7a1c1e209131cea81406 | | BH1 | 3.404 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 3.414 | Not recorded | 68fa7a1c1e209131cea81406 | | Rotor | 3.428 | Not recorded | 68fa7a1c1e209131cea81406 | | LR4 | 3.504 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 4.071 | Not recorded | 68fa7a1c1e209131cea81406 | | LR1 | 5.001 | Not recorded | 68fa7a1c1e209131cea81406 | ### Original Log-PPL: 2.834. Result ID: 699a48b85698665ec4d01904. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 2.854. Result ID: 699a48b85698665ec4d0191a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### Original Log-PPL: 2.862. Result ID: 699a48b85698665ec4d01974. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"0"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 2.865. Result ID: 699a48b85698665ec4d01914. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 2.874. Result ID: 699a48b85698665ec4d0190e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 2.877. Result ID: 699a48b85698665ec4d0197b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"1"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 2.878. Result ID: 699a48b85698665ec4d01979. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"1"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 2.88. Result ID: 699a48b85698665ec4d01977. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"1"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 2.881. Result ID: 699a48b85698665ec4d01975. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"1"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 2.884. Result ID: 699a48b85698665ec4d01908. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 2.897. Result ID: 699a48b85698665ec4d01915. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 2.898. Result ID: 699a48b85698665ec4d0197a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"2"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 2.9. Result ID: 699a48b85698665ec4d0191b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 2.901. Result ID: 699a48b85698665ec4d01978. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"2"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 2.901. Result ID: 699a48b85698665ec4d0197c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"2"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 2.905. Result ID: 699a48b85698665ec4d0190f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 2.907. Result ID: 699a48b85698665ec4d01976. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Fox-1.0 1.6B","Layer replacements":"2"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 2.91. Result ID: 699a48b85698665ec4d01909. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 2.975. Result ID: 699a48b85698665ec4d01916. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 2.977. Result ID: 699a48b85698665ec4d0191c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 2.98. Result ID: 699a48b85698665ec4d01910. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 2.985. Result ID: 699a48b85698665ec4d0190a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"Qwen-2.5 1.5B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### Original Log-PPL: 3.151. Result ID: 699a48b85698665ec4d01903. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 3.261. Result ID: 699a48b85698665ec4d01917. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 3.262. Result ID: 699a48b85698665ec4d01912. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 3.285. Result ID: 699a48b85698665ec4d01918. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 3.315. Result ID: 699a48b85698665ec4d0190c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 3.343. Result ID: 699a48b85698665ec4d01911. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 3.39. Result ID: 699a48b85698665ec4d0190b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### BH1 Log-PPL: 3.404. Result ID: 699a48b85698665ec4d01913. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 3.414. Result ID: 699a48b85698665ec4d01905. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"one"}. This record does not assert independent reproduction. ### Rotor Log-PPL: 3.428. Result ID: 699a48b85698665ec4d01919. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### LR4 Log-PPL: 3.504. Result ID: 699a48b85698665ec4d0190d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"three"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 4.071. Result ID: 699a48b85698665ec4d01906. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"two"}. This record does not assert independent reproduction. ### LR1 Log-PPL: 5.001. Result ID: 699a48b85698665ec4d01907. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Base Model":"LLaMa-3.2 1B","Number of layer replacements":"three"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.