# Web Agent Attack Success Rate on AGENTBAIT Evaluation Suite

Source: [Web Agent Attack Success Rate on AGENTBAIT Evaluation Suite](<https://www.sota2.com/research/sota/web-agent-attack-success-rate-on-agentbait-evaluation-suite>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:23:54.271Z

Evaluation of model performance on the AGENTBAIT Evaluation Suite, focusing on the Web Agent Attack Success Rate (ASR).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Web Agent Attack Success Rate |
| Dataset (including any stated split) | AGENTBAIT Evaluation Suite |
| Metric | ASR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ASR](<https://www.sota2.com/research/sota/web-agent-attack-success-rate-on-agentbait-evaluation-suite.md?metric=ASR>): Higher is better; unit: PERCENT.

- [Average ASR](<https://www.sota2.com/research/sota/web-agent-attack-success-rate-on-agentbait-evaluation-suite.md?metric=Average%20ASR>): Higher is better; unit: PERCENT.

## Recorded results

| Method | ASR | Result date | Report paper |
| --- | --- | --- | --- |
| Browser Use | 87 | Not recorded | 6965d1996343fa78c832366c |
| LiteWebAgent | 87 | Not recorded | 6965d1996343fa78c832366c |
| LiteWebAgent | 84 | Not recorded | 6965d1996343fa78c832366c |
| SeeAct | 81 | Not recorded | 6965d1996343fa78c832366c |
| Agent-E | 79 | Not recorded | 6965d1996343fa78c832366c |
| Browser Use | 78 | Not recorded | 6965d1996343fa78c832366c |
| Agent-E | 77 | Not recorded | 6965d1996343fa78c832366c |
| LiteWebAgent | 77 | Not recorded | 6965d1996343fa78c832366c |
| Skyvern-AI | 76 | Not recorded | 6965d1996343fa78c832366c |
| SeeAct | 75 | Not recorded | 6965d1996343fa78c832366c |
| Skyvern-AI | 74 | Not recorded | 6965d1996343fa78c832366c |
| Agent-E | 71 | Not recorded | 6965d1996343fa78c832366c |
| Browser Use | 71 | Not recorded | 6965d1996343fa78c832366c |
| Agent-E | 68 | Not recorded | 6965d1996343fa78c832366c |
| SeeAct | 64 | Not recorded | 6965d1996343fa78c832366c |
| Skyvern-AI | 62 | Not recorded | 6965d1996343fa78c832366c |
| LiteWebAgent | 60 | Not recorded | 6965d1996343fa78c832366c |
| SeeAct | 59 | Not recorded | 6965d1996343fa78c832366c |
| Agent-E | 58 | Not recorded | 6965d1996343fa78c832366c |
| LiteWebAgent | 52 | Not recorded | 6965d1996343fa78c832366c |
| Skyvern-AI | 52 | Not recorded | 6965d1996343fa78c832366c |
| Browser Use | 51 | Not recorded | 6965d1996343fa78c832366c |
| SeeAct | 49 | Not recorded | 6965d1996343fa78c832366c |
| Skyvern-AI | 49 | Not recorded | 6965d1996343fa78c832366c |
| Browser Use | 46 | Not recorded | 6965d1996343fa78c832366c |

### Browser Use

ASR: 87. Result ID: 6996efaf5698665ec43c3df4.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"+1"}. This record does not assert independent reproduction.

### LiteWebAgent

ASR: 87. Result ID: 6996efaf5698665ec43c3dfc.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78691e209131cea784b1.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"0"}. This record does not assert independent reproduction.

### LiteWebAgent

ASR: 84. Result ID: 6996efaf5698665ec43c3dfa.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78691e209131cea784b1.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"+1"}. This record does not assert independent reproduction.

### SeeAct

ASR: 81. Result ID: 6996efaf5698665ec43c3e00.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72821e209131cea56e28.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"+1"}. This record does not assert independent reproduction.

### Agent-E

ASR: 79. Result ID: 6996efaf5698665ec43c3dee.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74351e209131cea60720.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"+1"}. This record does not assert independent reproduction.

### Browser Use

ASR: 78. Result ID: 6996efaf5698665ec43c3df6.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"0"}. This record does not assert independent reproduction.

### Agent-E

ASR: 77. Result ID: 6996efaf5698665ec43c3ded.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74351e209131cea60720.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"0"}. This record does not assert independent reproduction.

### LiteWebAgent

ASR: 77. Result ID: 6996efaf5698665ec43c3df9.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78691e209131cea784b1.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"0"}. This record does not assert independent reproduction.

### Skyvern-AI

ASR: 76. Result ID: 6996efaf5698665ec43c3e08.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"0"}. This record does not assert independent reproduction.

### SeeAct

ASR: 75. Result ID: 6996efaf5698665ec43c3dff.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72821e209131cea56e28.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"0"}. This record does not assert independent reproduction.

### Skyvern-AI

ASR: 74. Result ID: 6996efaf5698665ec43c3e06.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"+1"}. This record does not assert independent reproduction.

### Agent-E

ASR: 71. Result ID: 6996efaf5698665ec43c3df0.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74351e209131cea60720.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"0"}. This record does not assert independent reproduction.

### Browser Use

ASR: 71. Result ID: 6996efaf5698665ec43c3df3.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"0"}. This record does not assert independent reproduction.

### Agent-E

ASR: 68. Result ID: 6996efaf5698665ec43c3def.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74351e209131cea60720.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### SeeAct

ASR: 64. Result ID: 6996efaf5698665ec43c3e02.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72821e209131cea56e28.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"0"}. This record does not assert independent reproduction.

### Skyvern-AI

ASR: 62. Result ID: 6996efaf5698665ec43c3e05.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"0"}. This record does not assert independent reproduction.

### LiteWebAgent

ASR: 60. Result ID: 6996efaf5698665ec43c3dfb.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78691e209131cea784b1.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### SeeAct

ASR: 59. Result ID: 6996efaf5698665ec43c3dfe.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72821e209131cea56e28.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### Agent-E

ASR: 58. Result ID: 6996efaf5698665ec43c3dec.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74351e209131cea60720.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### LiteWebAgent

ASR: 52. Result ID: 6996efaf5698665ec43c3df8.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78691e209131cea784b1.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### Skyvern-AI

ASR: 52. Result ID: 6996efaf5698665ec43c3e04.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### Browser Use

ASR: 51. Result ID: 6996efaf5698665ec43c3df5.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### SeeAct

ASR: 49. Result ID: 6996efaf5698665ec43c3e01.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72821e209131cea56e28.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### Skyvern-AI

ASR: 49. Result ID: 6996efaf5698665ec43c3e07.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"1","gamma (γ)":"-1"}. This record does not assert independent reproduction.

### Browser Use

ASR: 46. Result ID: 6996efaf5698665ec43c3df2.

[Reporting paper](<https://www.sota2.com/research/paper/6965d1996343fa78c832366c.md>)

Recorded evaluation configuration: {"alpha (α)":"0","gamma (γ)":"-1"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
