# Adversarial Attack Detection on Held-out n = 560 (20% stratified test)

Source: [Adversarial Attack Detection on Held-out n = 560 (20% stratified test)](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-11T08:50:01.717Z

Evaluation of a model's ability to detect adversarial attacks using a specific 20% stratified held-out test set containing 560 samples, reporting standard binary classification metrics like Detection Rate, Specificity, and AUC-ROC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Adversarial Attack Detection |
| Dataset (including any stated split) | Held-out n = 560 (20% stratified test) |
| Metric | Detection Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Detection Rate](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=Detection%20Rate>): Higher is better; unit: PERCENT.

- [False Positive Rate](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=False%20Positive%20Rate>): Lower is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=Precision>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Sensitivity](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=Sensitivity>): Higher is better; unit: PERCENT.

- [Specificity](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=Specificity>): Higher is better; unit: PERCENT.

- [MCC](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=MCC>): Higher is better; unit: SCALAR.

- [AUC-ROC](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=AUC-ROC>): Higher is better; unit: SCALAR.

- [Negative Predictive Value](<https://www.sota2.com/research/sota/adversarial-attack-detection-on-held-out-n-560-20-percent-stratified-test.md?metric=Negative%20Predictive%20Value>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Detection Rate | Result date | Report paper |
| --- | --- | --- | --- |
| Combined | 89.1 | Not recorded | 6a28f38290966ade919c1a74 |
| Prompt Layer | 73.3 | Not recorded | 6a28f38290966ade919c1a74 |
| Linguistic Patterns | 68.2 | Not recorded | 6a28f38290966ade919c1a74 |
| Code Layer | 67.8 | Not recorded | 6a28f38290966ade919c1a74 |
| Position Monitoring | 62.9 | Not recorded | 6a28f38290966ade919c1a74 |
| Semantic Validation | 54.1 | Not recorded | 6a28f38290966ade919c1a74 |
| Differential | 51.3 | Not recorded | 6a28f38290966ade919c1a74 |
| Static Analysis | 42.1 | Not recorded | 6a28f38290966ade919c1a74 |
| Perplexity Analysis | 41.7 | Not recorded | 6a28f38290966ade919c1a74 |
| Pattern Matching | 38.7 | Not recorded | 6a28f38290966ade919c1a74 |
| Taint Analysis | 29.4 | Not recorded | 6a28f38290966ade919c1a74 |

### Combined

Detection Rate: 89.1. Result ID: 6a2a76b8fbc373592c27af9b.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"System":"Dual-layer defense framework"}. This record does not assert independent reproduction.

### Prompt Layer

Detection Rate: 73.3. Result ID: 6a2a76b8fbc373592c27af95.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Type":"Aggregate Layer"}. This record does not assert independent reproduction.

### Linguistic Patterns

Detection Rate: 68.2. Result ID: 6a2a76b8fbc373592c27af91.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Prompt Layer"}. This record does not assert independent reproduction.

### Code Layer

Detection Rate: 67.8. Result ID: 6a2a76b8fbc373592c27af9a.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Type":"Aggregate Layer"}. This record does not assert independent reproduction.

### Position Monitoring

Detection Rate: 62.9. Result ID: 6a2a76b8fbc373592c27af93.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Prompt Layer"}. This record does not assert independent reproduction.

### Semantic Validation

Detection Rate: 54.1. Result ID: 6a2a76b8fbc373592c27af92.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Prompt Layer"}. This record does not assert independent reproduction.

### Differential

Detection Rate: 51.3. Result ID: 6a2a76b8fbc373592c27af99.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Code Layer"}. This record does not assert independent reproduction.

### Static Analysis

Detection Rate: 42.1. Result ID: 6a2a76b8fbc373592c27af96.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Code Layer"}. This record does not assert independent reproduction.

### Perplexity Analysis

Detection Rate: 41.7. Result ID: 6a2a76b8fbc373592c27af94.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Prompt Layer"}. This record does not assert independent reproduction.

### Pattern Matching

Detection Rate: 38.7. Result ID: 6a2a76b8fbc373592c27af97.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Code Layer"}. This record does not assert independent reproduction.

### Taint Analysis

Detection Rate: 29.4. Result ID: 6a2a76b8fbc373592c27af98.

[Reporting paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a28f38290966ade919c1a74.md>)

Recorded evaluation configuration: {"Layer":"Code Layer"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
