# Backdoor Detection on MNIST 20/20

Source: [Backdoor Detection on MNIST 20/20](<https://www.sota2.com/research/sota/backdoor-detection-on-mnist-20-20>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-20T07:25:13.684Z

Evaluation of backdoor detection performance on the specific MNIST 20/20 dataset variant, reporting metrics such as True Positive Rate (TPR), False Positive Rate (FPR), and processing time.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Backdoor Detection |
| Dataset (including any stated split) | MNIST 20/20 |
| Metric | TPR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [TPR](<https://www.sota2.com/research/sota/backdoor-detection-on-mnist-20-20.md?metric=TPR>): Higher is better; unit: PERCENT.

- [FPR](<https://www.sota2.com/research/sota/backdoor-detection-on-mnist-20-20.md?metric=FPR>): Lower is better; unit: PERCENT.

- [Processing Time](<https://www.sota2.com/research/sota/backdoor-detection-on-mnist-20-20.md?metric=Processing%20Time>): Lower is better; unit: TIME.

## Recorded results

| Method | TPR | Result date | Report paper |
| --- | --- | --- | --- |
| NC | 100 | Not recorded | 6a0d4017f984739ed6737814 |
| HTell | 100 | Not recorded | 6a0d4017f984739ed6737814 |
| BARBIE | 95 | Not recorded | 6a0d4017f984739ed6737814 |
| FeatureRE | 75 | Not recorded | 6a0d4017f984739ed6737814 |
| MM-BD | 60 | Not recorded | 6a0d4017f984739ed6737814 |
| DF-TND | 40 | Not recorded | 6a0d4017f984739ed6737814 |
| FreeEagle | 35 | Not recorded | 6a0d4017f984739ed6737814 |
| DQ | 15 | Not recorded | 6a0d4017f984739ed6737814 |

### NC

TPR: 100. Result ID: 6a0d61bdfbc373592c050931.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HTell

TPR: 100. Result ID: 6a0d61bdfbc373592c050938.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BARBIE

TPR: 95. Result ID: 6a0d61bdfbc373592c050937.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

Recorded evaluation configuration: {"accuracy\_limitation":"only identifies whether the model is backdoored"}. This record does not assert independent reproduction.

### FeatureRE

TPR: 75. Result ID: 6a0d61bdfbc373592c050932.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6dc51e209131cea3c0bb.md>)

[Implementation](<https://github.com/RU-System-Software-and-Security/FeatureRE>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MM-BD

TPR: 60. Result ID: 6a0d61bdfbc373592c050936.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70381e209131cea49a5e.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DF-TND

TPR: 40. Result ID: 6a0d61bdfbc373592c050933.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa680b1e209131cea19c39.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FreeEagle

TPR: 35. Result ID: 6a0d61bdfbc373592c050935.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb01e209131cea41782.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DQ

TPR: 15. Result ID: 6a0d61bdfbc373592c050934.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d4017f984739ed6737814.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ab61e209131cea29f18.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.