# Training Data Identification on WikiMIA alpha=0.3 1.0 (test)

Source: [Training Data Identification on WikiMIA alpha=0.3 1.0 (test)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-3-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:57:55.891Z

Evaluation of a model's ability to identify training data from the WikiMIA dataset, specifically using the alpha=0.3, 1.0 configuration on the test split, measured using Power metrics (Perplexity, MIN-K%, M-Entropy).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Training Data Identification |
| Dataset (including any stated split) | WikiMIA alpha=0.3 1.0 (test) |
| Metric | Perplexity |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Perplexity](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-3-1-0-test.md?metric=Perplexity>): Lower is better; unit: SCALAR.

- [MIN-K (%)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-3-1-0-test.md?metric=MIN-K%20(%25)>): Higher is better; unit: PERCENT.

- [M-Entropy](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-3-1-0-test.md?metric=M-Entropy>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Perplexity | Result date | Report paper |
| --- | --- | --- | --- |
| Vanilla | 2.9 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 2.92 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 3.03 | Not recorded | 68fa7c111e209131cea8c3fa |
| Vanilla | 3.86 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 3.88 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 3.92 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 5.36 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 6.28 | Not recorded | 68fa7c111e209131cea8c3fa |
| Vanilla | 6.77 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 6.91 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 7.69 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 10.85 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 17.55 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 18.75 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 30.56 | Not recorded | 68fa7c111e209131cea8c3fa |

### Vanilla

Perplexity: 2.9. Result ID: 699a54175698665ec4dbbed5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Quantile-BH

Perplexity: 2.92. Result ID: 699a54175698665ec4dbbed8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### BKY

Perplexity: 3.03. Result ID: 699a54175698665ec4dbbed7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Vanilla

Perplexity: 3.86. Result ID: 699a54175698665ec4dbbed0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Quantile-BH

Perplexity: 3.88. Result ID: 699a54175698665ec4dbbed3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### BKY

Perplexity: 3.92. Result ID: 699a54175698665ec4dbbed2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Storey-BH

Perplexity: 5.36. Result ID: 699a54175698665ec4dbbed1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Storey-BH

Perplexity: 6.28. Result ID: 699a54175698665ec4dbbed6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Vanilla

Perplexity: 6.77. Result ID: 699a54175698665ec4dbbecb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### Quantile-BH

Perplexity: 6.91. Result ID: 699a54175698665ec4dbbece.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### BKY

Perplexity: 7.69. Result ID: 699a54175698665ec4dbbecd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Perplexity: 10.85. Result ID: 699a54175698665ec4dbbed9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Perplexity: 17.55. Result ID: 699a54175698665ec4dbbed4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Storey-BH

Perplexity: 18.75. Result ID: 699a54175698665ec4dbbecc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Perplexity: 30.56. Result ID: 699a54175698665ec4dbbecf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
