# Adversarial Robustness Evaluation on Dataset of 200 scientific papers 1.0 (test)

Source: [Adversarial Robustness Evaluation on Dataset of 200 scientific papers 1.0 (test)](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:38:01.801Z

Evaluation of model adversarial robustness on the test split of the 'Dataset of 200 scientific papers 1.0', reporting performance across 15 specific robustness metrics (C1DRA, C1MSM, C3SP, etc.).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Adversarial Robustness Evaluation |
| Dataset (including any stated split) | Dataset of 200 scientific papers 1.0 (test) |
| Metric | C1DRA |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [C1DRA](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C1DRA>): Higher is better; unit: PERCENT.

- [C1MSM](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C1MSM>): Higher is better; unit: PERCENT.

- [C1SA](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C1SA>): Higher is better; unit: PERCENT.

- [C1SMCR](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C1SMCR>): Higher is better; unit: PERCENT.

- [C2CRA](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C2CRA>): Higher is better; unit: PERCENT.

- [C2FA](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C2FA>): Higher is better; unit: PERCENT.

- [C2LDA](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C2LDA>): Higher is better; unit: PERCENT.

- [C2SN](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C2SN>): Higher is better; unit: PERCENT.

- [C2TF](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C2TF>): Higher is better; unit: PERCENT.

- [C3AE](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C3AE>): Higher is better; unit: PERCENT.

- [C3EBP](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C3EBP>): Higher is better; unit: PERCENT.

- [C3EE](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C3EE>): Higher is better; unit: PERCENT.

- [C3LA](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C3LA>): Higher is better; unit: PERCENT.

- [C3NEE](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C3NEE>): Higher is better; unit: PERCENT.

- [C3SP](<https://www.sota2.com/research/sota/adversarial-robustness-evaluation-on-dataset-of-200-scientific-papers-1-0-test.md?metric=C3SP>): Higher is better; unit: PERCENT.

## Recorded results

| Method | C1DRA | Result date | Report paper |
| --- | --- | --- | --- |
| mistral-small | 86.26 | Not recorded | 693ba1676cfd488761a55053 |
| gemma3 | 80.6 | Not recorded | 693ba1676cfd488761a55053 |
| falcon3 | 66.75 | Not recorded | 693ba1676cfd488761a55053 |
| deepseek-r1 | 47.65 | Not recorded | 693ba1676cfd488761a55053 |
| llama3.1 | 38.57 | Not recorded | 693ba1676cfd488761a55053 |
| tulu3 | 35.35 | Not recorded | 693ba1676cfd488761a55053 |
| gemini-2.5-pro | 4.35 | Not recorded | 693ba1676cfd488761a55053 |
| gpt-oss | 3.71 | Not recorded | 693ba1676cfd488761a55053 |
| qwen3 | 1.15 | Not recorded | 693ba1676cfd488761a55053 |
| claude-haiku-4-5 | 0 | Not recorded | 693ba1676cfd488761a55053 |
| gemini-2.5-flash | 0 | Not recorded | 693ba1676cfd488761a55053 |
| gpt-5 | 0 | Not recorded | 693ba1676cfd488761a55053 |
| gpt-5-mini | 0 | Not recorded | 693ba1676cfd488761a55053 |

### mistral-small

C1DRA: 86.26. Result ID: 699628dd5698665ec469e731.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### gemma3

C1DRA: 80.6. Result ID: 699628dd5698665ec469e72e.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### falcon3

C1DRA: 66.75. Result ID: 699628dd5698665ec469e72d.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### deepseek-r1

C1DRA: 47.65. Result ID: 699628dd5698665ec469e72c.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a91e209131cea6e3eb.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### llama3.1

C1DRA: 38.57. Result ID: 699628dd5698665ec469e730.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### tulu3

C1DRA: 35.35. Result ID: 699628dd5698665ec469e733.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78121e209131cea76a04.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### gemini-2.5-pro

C1DRA: 4.35. Result ID: 699628dd5698665ec469e736.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Closed-Source"}. This record does not assert independent reproduction.

### gpt-oss

C1DRA: 3.71. Result ID: 699628dd5698665ec469e72f.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7ab01e209131cea84a0c.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### qwen3

C1DRA: 1.15. Result ID: 699628dd5698665ec469e732.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa788e1e209131cea79116.md>)

Recorded evaluation configuration: {"Model Type":"Open-Source"}. This record does not assert independent reproduction.

### claude-haiku-4-5

C1DRA: 0. Result ID: 699628dd5698665ec469e734.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Closed-Source"}. This record does not assert independent reproduction.

### gemini-2.5-flash

C1DRA: 0. Result ID: 699628dd5698665ec469e735.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Closed-Source"}. This record does not assert independent reproduction.

### gpt-5

C1DRA: 0. Result ID: 699628dd5698665ec469e737.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Closed-Source"}. This record does not assert independent reproduction.

### gpt-5-mini

C1DRA: 0. Result ID: 699628dd5698665ec469e738.

[Reporting paper](<https://www.sota2.com/research/paper/693ba1676cfd488761a55053.md>)

Recorded evaluation configuration: {"Model Type":"Closed-Source"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
