# Training Data Identification on WikiMIA alpha=0.1 1.0 (test)

Source: [Training Data Identification on WikiMIA alpha=0.1 1.0 (test)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-1-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:58:10.816Z

Evaluation of a model's ability to identify training data from the WikiMIA dataset, specifically using the alpha=0.1, 1.0 configuration on the test split, measured using Power metrics (Perplexity, MIN-K%, M-Entropy).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Training Data Identification |
| Dataset (including any stated split) | WikiMIA alpha=0.1 1.0 (test) |
| Metric | Power Perplexity |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Power Perplexity](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-1-1-0-test.md?metric=Power%20Perplexity>): Lower is better; unit: SCALAR.

- [Power MIN-K%](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-1-1-0-test.md?metric=Power%20MIN-K%25>): Lower is better; unit: SCALAR.

- [Power M-Entropy](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-1-1-0-test.md?metric=Power%20M-Entropy>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Power Perplexity | Result date | Report paper |
| --- | --- | --- | --- |
| Vanilla | 0.21 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 0.21 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 0.22 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 0.41 | Not recorded | 68fa7c111e209131cea8c3fa |
| Vanilla | 0.46 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 0.47 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 0.47 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 0.48 | Not recorded | 68fa7c111e209131cea8c3fa |
| Vanilla | 0.9 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 0.92 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 0.93 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 1.07 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 1.65 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 1.94 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 2.64 | Not recorded | 68fa7c111e209131cea8c3fa |

### Vanilla

Power Perplexity: 0.21. Result ID: 699a54175698665ec4dbbeb7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### BKY

Power Perplexity: 0.21. Result ID: 699a54175698665ec4dbbeb9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Quantile-BH

Power Perplexity: 0.22. Result ID: 699a54175698665ec4dbbeba.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Storey-BH

Power Perplexity: 0.41. Result ID: 699a54175698665ec4dbbeb8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Vanilla

Power Perplexity: 0.46. Result ID: 699a54175698665ec4dbbead.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### BKY

Power Perplexity: 0.47. Result ID: 699a54175698665ec4dbbeaf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### Quantile-BH

Power Perplexity: 0.47. Result ID: 699a54175698665ec4dbbeb0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Power Perplexity: 0.48. Result ID: 699a54175698665ec4dbbebb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Vanilla

Power Perplexity: 0.9. Result ID: 699a54175698665ec4dbbeb2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### BKY

Power Perplexity: 0.92. Result ID: 699a54175698665ec4dbbeb4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Quantile-BH

Power Perplexity: 0.93. Result ID: 699a54175698665ec4dbbeb5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Storey-BH

Power Perplexity: 1.07. Result ID: 699a54175698665ec4dbbeae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Power Perplexity: 1.65. Result ID: 699a54175698665ec4dbbeb1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### Storey-BH

Power Perplexity: 1.94. Result ID: 699a54175698665ec4dbbeb3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Power Perplexity: 2.64. Result ID: 699a54175698665ec4dbbeb6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
