# Training Data Identification on WikiMIA alpha=0.2 1.0 (test)

Source: [Training Data Identification on WikiMIA alpha=0.2 1.0 (test)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-2-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:58:10.777Z

Evaluation of a model's ability to identify training data membership within the WikiMIA dataset, specifically using the alpha=0.2, 1.0 configuration on the test split.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Training Data Identification |
| Dataset (including any stated split) | WikiMIA alpha=0.2 1.0 (test) |
| Metric | Power (Perplexity) |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Power (Perplexity)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-2-1-0-test.md?metric=Power%20(Perplexity)>): Lower is better; unit: SCALAR.

- [Power (MIN-K%)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-2-1-0-test.md?metric=Power%20(MIN-K%25)>): Higher is better; unit: PERCENT.

- [Power (M-Entropy)](<https://www.sota2.com/research/sota/training-data-identification-on-wikimia-alpha-0-2-1-0-test.md?metric=Power%20(M-Entropy)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Power (Perplexity) | Result date | Report paper |
| --- | --- | --- | --- |
| Vanilla | 1.04 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 1.05 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 1.06 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 2.04 | Not recorded | 68fa7c111e209131cea8c3fa |
| Vanilla | 2.37 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 2.39 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 2.46 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 3.07 | Not recorded | 68fa7c111e209131cea8c3fa |
| Vanilla | 3.15 | Not recorded | 68fa7c111e209131cea8c3fa |
| Quantile-BH | 3.16 | Not recorded | 68fa7c111e209131cea8c3fa |
| BKY | 3.18 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 3.61 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 5.49 | Not recorded | 68fa7c111e209131cea8c3fa |
| Storey-BH | 6 | Not recorded | 68fa7c111e209131cea8c3fa |
| PTDI (Ours) | 10.75 | Not recorded | 68fa7c111e209131cea8c3fa |

### Vanilla

Power (Perplexity): 1.04. Result ID: 699a54175698665ec4dbbec6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Quantile-BH

Power (Perplexity): 1.05. Result ID: 699a54175698665ec4dbbec9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### BKY

Power (Perplexity): 1.06. Result ID: 699a54175698665ec4dbbec8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Storey-BH

Power (Perplexity): 2.04. Result ID: 699a54175698665ec4dbbec7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Vanilla

Power (Perplexity): 2.37. Result ID: 699a54175698665ec4dbbebc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### Quantile-BH

Power (Perplexity): 2.39. Result ID: 699a54175698665ec4dbbebf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### BKY

Power (Perplexity): 2.46. Result ID: 699a54175698665ec4dbbebe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Power (Perplexity): 3.07. Result ID: 699a54175698665ec4dbbeca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"Pythia-6.9B"}. This record does not assert independent reproduction.

### Vanilla

Power (Perplexity): 3.15. Result ID: 699a54175698665ec4dbbec1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Quantile-BH

Power (Perplexity): 3.16. Result ID: 699a54175698665ec4dbbec4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### BKY

Power (Perplexity): 3.18. Result ID: 699a54175698665ec4dbbec3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Storey-BH

Power (Perplexity): 3.61. Result ID: 699a54175698665ec4dbbec2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Power (Perplexity): 5.49. Result ID: 699a54175698665ec4dbbec5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"LLaMA-7B"}. This record does not assert independent reproduction.

### Storey-BH

Power (Perplexity): 6. Result ID: 699a54175698665ec4dbbebd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

### PTDI (Ours)

Power (Perplexity): 10.75. Result ID: 699a54175698665ec4dbbec0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3fa.md>)

Recorded evaluation configuration: {"Backbone Model":"NeoX-20B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
