Web Automation on MiniWoB++ 56 tasks (test)
99.2Success RateSOTA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SOTAData=N/A2023.07 | 99.2 | — | |
| HTML-T5-XLData=347K2023.07 | 85.6 | — | |
| Flan-T5-XXLData=347K2023.07 | 79 | — | |
| Flan-T5-XLData=347K2023.07 | 75.5 | — | |
| HTML-T5-XLData=12K2023.07 | 67.1 | 6.7 | |
| Flan-LongT5-XLData=12K2023.07 | 61.1 | 0.7 | |
| HTML-T5-LargeData=12K2023.07 | 60.8 | 4.5 | |
| LongT5-XLData=12K2023.07 | 60.4 | 0 | |
| HTML-T5-BaseData=12K2023.07 | 57 | 3.2 | |
| LongT5-LargeData=12K2023.07 | 56.3 | 0 | |
| Flan-LongT5-LargeData=12K2023.07 | 56.1 | -0.2 | |
| Flan-LongT5-BaseData=12K2023.07 | 54.1 | 0.3 | |
| LongT5-BaseData=12K2023.07 | 53.8 | 0 | |
| WebN-T5-XLData=12K2023.07 | 48.4 | — | |
| CC-NetData=2.4M2023.07 | 32 | — |