# Knowledge Unlearning on The Pile 32 sample (val)

Source: [Knowledge Unlearning on The Pile 32 sample (val)](<https://www.sota2.com/research/sota/knowledge-unlearning-on-the-pile-32-sample-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:41:30.665Z

Evaluation of Knowledge Unlearning performance on the 32-sample validation split of The Pile dataset, typically measured using EL10 and MA metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Knowledge Unlearning |
| Dataset (including any stated split) | The Pile 32 sample (val) |
| Metric | EL10 (%) |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [EL10 (%)](<https://www.sota2.com/research/sota/knowledge-unlearning-on-the-pile-32-sample-val.md?metric=EL10%20(%25)>): Lower is better; unit: PERCENT.

- [MA (%)](<https://www.sota2.com/research/sota/knowledge-unlearning-on-the-pile-32-sample-val.md?metric=MA%20(%25)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | EL10 (%) | Result date | Report paper |
| --- | --- | --- | --- |
| NEO + DPD+ | 0 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + DPD+ | 0 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + DPD+ | 0 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + UL+ | 1 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + UL+ | 1.6 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + UL+ | 1.9 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + UL | 3.7 | Not recorded | 68fa6e421e209131cea3ec45 |
| OPT | 8.6 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + UL | 11 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO + UL | 13 | Not recorded | 68fa6e421e209131cea3ec45 |
| OPT | 23.3 | Not recorded | 68fa6e421e209131cea3ec45 |
| OPT | 25.6 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO | 30.9 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO | 67.6 | Not recorded | 68fa6e421e209131cea3ec45 |
| NEO | 70.4 | Not recorded | 68fa6e421e209131cea3ec45 |

### NEO + DPD+

EL10 (%): 0. Result ID: 699020e03a6c314849fe4e25.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"125M","Epoch":null}. This record does not assert independent reproduction.

### NEO + DPD+

EL10 (%): 0. Result ID: 699020e03a6c314849fe4e2a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"1.3B","Epoch":null}. This record does not assert independent reproduction.

### NEO + DPD+

EL10 (%): 0. Result ID: 699020e03a6c314849fe4e2f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"2.7B","Epoch":null}. This record does not assert independent reproduction.

### NEO + UL+

EL10 (%): 1. Result ID: 699020e03a6c314849fe4e27.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"125M","Epoch":17.2}. This record does not assert independent reproduction.

### NEO + UL+

EL10 (%): 1.6. Result ID: 699020e03a6c314849fe4e31.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"2.7B","Epoch":10.8}. This record does not assert independent reproduction.

### NEO + UL+

EL10 (%): 1.9. Result ID: 699020e03a6c314849fe4e2c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"1.3B","Epoch":13.8}. This record does not assert independent reproduction.

### NEO + UL

EL10 (%): 3.7. Result ID: 699020e03a6c314849fe4e26.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"125M","Epoch":11}. This record does not assert independent reproduction.

### OPT

EL10 (%): 8.6. Result ID: 699020e03a6c314849fe4e23.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cda1e209131cea36474.md>)

[Implementation](<https://github.com/facebookresearch/metaseq>)

Recorded evaluation configuration: {"Params":"125M","Epoch":null}. This record does not assert independent reproduction.

### NEO + UL

EL10 (%): 11. Result ID: 699020e03a6c314849fe4e2b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"1.3B","Epoch":8}. This record does not assert independent reproduction.

### NEO + UL

EL10 (%): 13. Result ID: 699020e03a6c314849fe4e30.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Implementation](<https://github.com/joeljang/knowledge-unlearning>)

Recorded evaluation configuration: {"Params":"2.7B","Epoch":5.4}. This record does not assert independent reproduction.

### OPT

EL10 (%): 23.3. Result ID: 699020e03a6c314849fe4e28.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cda1e209131cea36474.md>)

[Implementation](<https://github.com/facebookresearch/metaseq>)

Recorded evaluation configuration: {"Params":"1.3B","Epoch":null}. This record does not assert independent reproduction.

### OPT

EL10 (%): 25.6. Result ID: 699020e03a6c314849fe4e2d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cda1e209131cea36474.md>)

[Implementation](<https://github.com/facebookresearch/metaseq>)

Recorded evaluation configuration: {"Params":"2.7B","Epoch":null}. This record does not assert independent reproduction.

### NEO

EL10 (%): 30.9. Result ID: 699020e03a6c314849fe4e24.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

Recorded evaluation configuration: {"Params":"125M","Epoch":null}. This record does not assert independent reproduction.

### NEO

EL10 (%): 67.6. Result ID: 699020e03a6c314849fe4e29.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

Recorded evaluation configuration: {"Params":"1.3B","Epoch":null}. This record does not assert independent reproduction.

### NEO

EL10 (%): 70.4. Result ID: 699020e03a6c314849fe4e2e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6e421e209131cea3ec45.md>)

Recorded evaluation configuration: {"Params":"2.7B","Epoch":null}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
