# Language Modeling on WikiText-103 (fine-tuned)

Source: [Language Modeling on WikiText-103 (fine-tuned)](<https://www.sota2.com/research/sota/language-modeling-on-wikitext-103-fine-tuned>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:57:57.650Z

Evaluation of language modeling performance using the fine-tuned version of the WikiText-103 dataset, typically measured by Perplexity (PPL).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Language Modeling |
| Dataset (including any stated split) | WikiText103 fine-tuned |
| Metric | Perplexity (PPL) |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Perplexity (PPL)](<https://www.sota2.com/research/sota/language-modeling-on-wikitext-103-fine-tuned.md?metric=Perplexity%20(PPL)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Perplexity (PPL) | Result date | Report paper |
| --- | --- | --- | --- |
| LTE | 5.95 | Not recorded | 68fa76221e209131cea6b680 |
| Wanda (Unstructured) | 6.87 | Not recorded | 68fa76221e209131cea6b680 |
| Wanda (Unstructured) | 7.04 | Not recorded | 68fa76221e209131cea6b680 |
| Wanda (4:8) | 8.17 | Not recorded | 68fa76221e209131cea6b680 |
| Wanda (4:8) | 8.39 | Not recorded | 68fa76221e209131cea6b680 |
| Wanda (2:4) | 10.82 | Not recorded | 68fa76221e209131cea6b680 |
| Wanda (2:4) | 11.45 | Not recorded | 68fa76221e209131cea6b680 |

### LTE

Perplexity (PPL): 5.95. Result ID: 699425f03a6c3148491b648a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Implementation](<https://github.com/haizhongzheng/LTE>)

Recorded evaluation configuration: {"Overall Sparsity":"52%","Calibration Data":"Wiki","Backbone Model":"LLaMA-7B","η":"2"}. This record does not assert independent reproduction.

### Wanda (Unstructured)

Perplexity (PPL): 6.87. Result ID: 699425f03a6c3148491b6489.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73281e209131cea5ac45.md>)

Recorded evaluation configuration: {"Overall Sparsity":"50%","Calibration Data":"Wiki","Backbone Model":"LLaMA-7B","Pruning Type":"Unstructured"}. This record does not assert independent reproduction.

### Wanda (Unstructured)

Perplexity (PPL): 7.04. Result ID: 699425f03a6c3148491b6486.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73281e209131cea5ac45.md>)

Recorded evaluation configuration: {"Overall Sparsity":"50%","Calibration Data":"C4","Backbone Model":"LLaMA-7B","Pruning Type":"Unstructured"}. This record does not assert independent reproduction.

### Wanda (4:8)

Perplexity (PPL): 8.17. Result ID: 699425f03a6c3148491b6488.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73281e209131cea5ac45.md>)

Recorded evaluation configuration: {"Overall Sparsity":"50%","Calibration Data":"Wiki","Backbone Model":"LLaMA-7B","Pruning Type":"4:8"}. This record does not assert independent reproduction.

### Wanda (4:8)

Perplexity (PPL): 8.39. Result ID: 699425f03a6c3148491b6485.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73281e209131cea5ac45.md>)

Recorded evaluation configuration: {"Overall Sparsity":"50%","Calibration Data":"C4","Backbone Model":"LLaMA-7B","Pruning Type":"4:8"}. This record does not assert independent reproduction.

### Wanda (2:4)

Perplexity (PPL): 10.82. Result ID: 699425f03a6c3148491b6487.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73281e209131cea5ac45.md>)

Recorded evaluation configuration: {"Overall Sparsity":"50%","Calibration Data":"Wiki","Backbone Model":"LLaMA-7B","Pruning Type":"2:4"}. This record does not assert independent reproduction.

### Wanda (2:4)

Perplexity (PPL): 11.45. Result ID: 699425f03a6c3148491b6484.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76221e209131cea6b680.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73281e209131cea5ac45.md>)

Recorded evaluation configuration: {"Overall Sparsity":"50%","Calibration Data":"C4","Backbone Model":"LLaMA-7B","Pruning Type":"2:4"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.