# Pruning on Pythia 1B (16L), 410M (24L) (val) Source: [Pruning on Pythia 1B (16L), 410M (24L) (val)]() Collection index: [llms.txt]() Data updated: 2026-04-28T07:00:07.660Z Evaluation of model pruning effectiveness on the validation split of the Pythia 1B (16L) and 410M (24L) models, measured by ΔPPL and L-N/ZA. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Pruning | | Dataset (including any stated split) | Pythia 1B (16L), 410M (24L) (val) | | Metric | ΔPPL | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ΔPPL](): Lower is better; unit: SCALAR. - [L-N/ZA](): Higher is better; unit: SCALAR. ## Recorded results | Method | ΔPPL | Result date | Report paper | | --- | --- | --- | --- | | Last-N | 4.4 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 4.4 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 4.43 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 4.87 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 5.6 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 6.1 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 7 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 7.34 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 10.12 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 11.11 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 11.61 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 11.83 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 15.23 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 20.9 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 23.77 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 27.95 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 33.08 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 40.4 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 41.89 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 53.36 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 55.32 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 83.2 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 86.58 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 99.23 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 117.92 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 121.21 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 199.12 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 258.24 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 310.01 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 320.82 | Not recorded | 69f03f0755a3c32af89f9f94 | | Zone-Aware | 707.73 | Not recorded | 69f03f0755a3c32af89f9f94 | | Last-N | 1383.35 | Not recorded | 69f03f0755a3c32af89f9f94 | | Random | 2129 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 11703 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 15146 | Not recorded | 69f03f0755a3c32af89f9f94 | | Worst | 29548 | Not recorded | 69f03f0755a3c32af89f9f94 | ### Last-N ΔPPL: 4.4. Result ID: 69f05a1847f34ce924d5a4d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"1"}. This record does not assert independent reproduction. ### Worst ΔPPL: 4.4. Result ID: 69f05a1847f34ce924d5a4d8. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"1"}. This record does not assert independent reproduction. ### Random ΔPPL: 4.43. Result ID: 69f05a1847f34ce924d5a4d7. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"1"}. This record does not assert independent reproduction. ### Random ΔPPL: 4.87. Result ID: 69f05a1847f34ce924d5a4c7. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"1"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 5.6. Result ID: 69f05a1847f34ce924d5a4c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"1"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 6.1. Result ID: 69f05a1847f34ce924d5a4c6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"1"}. This record does not assert independent reproduction. ### Worst ΔPPL: 7. Result ID: 69f05a1847f34ce924d5a4dc. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"2"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 7.34. Result ID: 69f05a1847f34ce924d5a4d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"1"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 10.12. Result ID: 69f05a1847f34ce924d5a4da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"2"}. This record does not assert independent reproduction. ### Random ΔPPL: 11.11. Result ID: 69f05a1847f34ce924d5a4db. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"2"}. This record does not assert independent reproduction. ### Random ΔPPL: 11.61. Result ID: 69f05a1847f34ce924d5a4cb. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"2"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 11.83. Result ID: 69f05a1847f34ce924d5a4c9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"2"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 15.23. Result ID: 69f05a1847f34ce924d5a4ca. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"2"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 20.9. Result ID: 69f05a1847f34ce924d5a4cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"3"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 23.77. Result ID: 69f05a1847f34ce924d5a4d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"2"}. This record does not assert independent reproduction. ### Random ΔPPL: 27.95. Result ID: 69f05a1847f34ce924d5a4cf. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"3"}. This record does not assert independent reproduction. ### Worst ΔPPL: 33.08. Result ID: 69f05a1847f34ce924d5a4e0. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"4"}. This record does not assert independent reproduction. ### Worst ΔPPL: 40.4. Result ID: 69f05a1847f34ce924d5a4c8. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"1"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 41.89. Result ID: 69f05a1847f34ce924d5a4de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"4"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 53.36. Result ID: 69f05a1847f34ce924d5a4ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"3"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 55.32. Result ID: 69f05a1847f34ce924d5a4d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"4"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 83.2. Result ID: 69f05a1847f34ce924d5a4dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"4"}. This record does not assert independent reproduction. ### Worst ΔPPL: 86.58. Result ID: 69f05a1847f34ce924d5a4cc. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"2"}. This record does not assert independent reproduction. ### Worst ΔPPL: 99.23. Result ID: 69f05a1847f34ce924d5a4e4. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"6"}. This record does not assert independent reproduction. ### Random ΔPPL: 117.92. Result ID: 69f05a1847f34ce924d5a4d3. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"4"}. This record does not assert independent reproduction. ### Random ΔPPL: 121.21. Result ID: 69f05a1847f34ce924d5a4df. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"4"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 199.12. Result ID: 69f05a1847f34ce924d5a4d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"4"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 258.24. Result ID: 69f05a1847f34ce924d5a4e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"6"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 310.01. Result ID: 69f05a1847f34ce924d5a4e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"6"}. This record does not assert independent reproduction. ### Random ΔPPL: 320.82. Result ID: 69f05a1847f34ce924d5a4e3. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"6"}. This record does not assert independent reproduction. ### Zone-Aware ΔPPL: 707.73. Result ID: 69f05a1847f34ce924d5a4e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"8"}. This record does not assert independent reproduction. ### Last-N ΔPPL: 1383.35. Result ID: 69f05a1847f34ce924d5a4e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"8"}. This record does not assert independent reproduction. ### Random ΔPPL: 2129. Result ID: 69f05a1847f34ce924d5a4e7. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"8"}. This record does not assert independent reproduction. ### Worst ΔPPL: 11703. Result ID: 69f05a1847f34ce924d5a4d0. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"3"}. This record does not assert independent reproduction. ### Worst ΔPPL: 15146. Result ID: 69f05a1847f34ce924d5a4d4. [Reporting paper]() Recorded evaluation configuration: {"Model":"1B (16L)","k":"4"}. This record does not assert independent reproduction. ### Worst ΔPPL: 29548. Result ID: 69f05a1847f34ce924d5a4e8. [Reporting paper]() Recorded evaluation configuration: {"Model":"410M (24L)","k":"8"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.