# Red-teaming on Web-Augmented LLM Red-Teaming Evaluation Set

Source: [Red-teaming on Web-Augmented LLM Red-Teaming Evaluation Set](<https://www.sota2.com/research/sota/red-teaming-on-web-augmented-llm-red-teaming-evaluation-set>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-20T06:43:48.964Z

Evaluation of LLM robustness and safety using the Web-Augmented LLM Red-Teaming Evaluation Set, focusing on detection rates, toxicity, and diversity of adversarial outcomes.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Red-teaming |
| Dataset (including any stated split) | Web-Augmented LLM Red-Teaming Evaluation Set |
| Metric | Detection Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Detection Rate](<https://www.sota2.com/research/sota/red-teaming-on-web-augmented-llm-red-teaming-evaluation-set.md?metric=Detection%20Rate>): Higher is better; unit: PERCENT.

- [Toxicity Rate](<https://www.sota2.com/research/sota/red-teaming-on-web-augmented-llm-red-teaming-evaluation-set.md?metric=Toxicity%20Rate>): Lower is better; unit: PERCENT.

- [Diversity Score](<https://www.sota2.com/research/sota/red-teaming-on-web-augmented-llm-red-teaming-evaluation-set.md?metric=Diversity%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Detection Rate | Result date | Report paper |
| --- | --- | --- | --- |
| CREST-Search | 80.5 | Not recorded | 68fa7c111e209131cea8c3e8 |
| HarmBench | 11.6 | Not recorded | 68fa7c111e209131cea8c3e8 |
| DangerousQA | 10.5 | Not recorded | 68fa7c111e209131cea8c3e8 |
| RED-EVAL | 5.7 | Not recorded | 68fa7c111e209131cea8c3e8 |
| UAT | 5.2 | Not recorded | 68fa7c111e209131cea8c3e8 |

### CREST-Search

Detection Rate: 80.5. Result ID: 69e5cad447f34ce924cb5a46.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3e8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3e8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HarmBench

Detection Rate: 11.6. Result ID: 69e5cad447f34ce924cb5a45.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3e8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa725d1e209131cea55fa2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DangerousQA

Detection Rate: 10.5. Result ID: 69e5cad447f34ce924cb5a44.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3e8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f921e209131cea46581.md>)

[Implementation](<https://github.com/SALT-NLP/chain-of-thought-bias>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RED-EVAL

Detection Rate: 5.7. Result ID: 69e5cad447f34ce924cb5a43.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3e8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70701e209131cea4af8b.md>)

[Implementation](<https://github.com/declare-lab/red-instruct>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### UAT

Detection Rate: 5.2. Result ID: 69e5cad447f34ce924cb5a42.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c111e209131cea8c3e8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71861e209131cea51c3b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
