# Web Automation on MiniWoB++ 56 tasks (test)

Source: [Web Automation on MiniWoB++ 56 tasks (test)](<https://www.sota2.com/research/sota/web-automation-on-miniwob-plus-plus-56-tasks-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:05:01.549Z

Evaluation of web agent performance on the 56 tasks included in the MiniWoB++ test set, measured by success rate.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Web Automation |
| Dataset (including any stated split) | MiniWoB++ 56 tasks (test) |
| Metric | Success Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate](<https://www.sota2.com/research/sota/web-automation-on-miniwob-plus-plus-56-tasks-test.md?metric=Success%20Rate>): Higher is better; unit: PERCENT.

- [Difference Metric](<https://www.sota2.com/research/sota/web-automation-on-miniwob-plus-plus-56-tasks-test.md?metric=Difference%20Metric>): Lower is better; unit: OTHER.

## Recorded results

| Method | Success Rate | Result date | Report paper |
| --- | --- | --- | --- |
| SOTA | 99.2 | Not recorded | 68fa72591e209131cea55d4d |
| HTML-T5-XL | 85.6 | Not recorded | 68fa72591e209131cea55d4d |
| Flan-T5-XXL | 79 | Not recorded | 68fa72591e209131cea55d4d |
| Flan-T5-XL | 75.5 | Not recorded | 68fa72591e209131cea55d4d |
| HTML-T5-XL | 67.1 | Not recorded | 68fa72591e209131cea55d4d |
| Flan-LongT5-XL | 61.1 | Not recorded | 68fa72591e209131cea55d4d |
| HTML-T5-Large | 60.8 | Not recorded | 68fa72591e209131cea55d4d |
| LongT5-XL | 60.4 | Not recorded | 68fa72591e209131cea55d4d |
| HTML-T5-Base | 57 | Not recorded | 68fa72591e209131cea55d4d |
| LongT5-Large | 56.3 | Not recorded | 68fa72591e209131cea55d4d |
| Flan-LongT5-Large | 56.1 | Not recorded | 68fa72591e209131cea55d4d |
| Flan-LongT5-Base | 54.1 | Not recorded | 68fa72591e209131cea55d4d |
| LongT5-Base | 53.8 | Not recorded | 68fa72591e209131cea55d4d |
| WebN-T5-XL | 48.4 | Not recorded | 68fa72591e209131cea55d4d |
| CC-Net | 32 | Not recorded | 68fa72591e209131cea55d4d |

### SOTA

Success Rate: 99.2. Result ID: 69921b5a3a6c3148490c9cd4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71d71e209131cea534a8.md>)

Recorded evaluation configuration: {"Data":"N/A"}. This record does not assert independent reproduction.

### HTML-T5-XL

Success Rate: 85.6. Result ID: 69921b5a3a6c3148490c9ce2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

Recorded evaluation configuration: {"Data":"347K"}. This record does not assert independent reproduction.

### Flan-T5-XXL

Success Rate: 79. Result ID: 69921b5a3a6c3148490c9ce1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e201e209131cea3dfa7.md>)

[Implementation](<https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints>)

Recorded evaluation configuration: {"Data":"347K"}. This record does not assert independent reproduction.

### Flan-T5-XL

Success Rate: 75.5. Result ID: 69921b5a3a6c3148490c9ce0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e201e209131cea3dfa7.md>)

[Implementation](<https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints>)

Recorded evaluation configuration: {"Data":"347K"}. This record does not assert independent reproduction.

### HTML-T5-XL

Success Rate: 67.1. Result ID: 69921b5a3a6c3148490c9cdf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### Flan-LongT5-XL

Success Rate: 61.1. Result ID: 69921b5a3a6c3148490c9cdc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e201e209131cea3dfa7.md>)

[Implementation](<https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### HTML-T5-Large

Success Rate: 60.8. Result ID: 69921b5a3a6c3148490c9cde.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### LongT5-XL

Success Rate: 60.4. Result ID: 69921b5a3a6c3148490c9cd9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7c1e209131cea34428.md>)

[Implementation](<https://github.com/google-research/longt5>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### HTML-T5-Base

Success Rate: 57. Result ID: 69921b5a3a6c3148490c9cdd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### LongT5-Large

Success Rate: 56.3. Result ID: 69921b5a3a6c3148490c9cd8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7c1e209131cea34428.md>)

[Implementation](<https://github.com/google-research/longt5>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### Flan-LongT5-Large

Success Rate: 56.1. Result ID: 69921b5a3a6c3148490c9cdb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e201e209131cea3dfa7.md>)

[Implementation](<https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### Flan-LongT5-Base

Success Rate: 54.1. Result ID: 69921b5a3a6c3148490c9cda.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e201e209131cea3dfa7.md>)

[Implementation](<https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### LongT5-Base

Success Rate: 53.8. Result ID: 69921b5a3a6c3148490c9cd7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c7c1e209131cea34428.md>)

[Implementation](<https://github.com/google-research/longt5>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### WebN-T5-XL

Success Rate: 48.4. Result ID: 69921b5a3a6c3148490c9cd6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f6f1e209131cea458ce.md>)

Recorded evaluation configuration: {"Data":"12K"}. This record does not assert independent reproduction.

### CC-Net

Success Rate: 32. Result ID: 69921b5a3a6c3148490c9cd5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72591e209131cea55d4d.md>)

Recorded evaluation configuration: {"Data":"2.4M"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
