Web Automation on MiniWob 45 tasks subset (test)
86.1Mean Success RateWebGUM
Evaluation results
| Method | Links | |
|---|---|---|
| WebGUMModality=HTML+Image, Training data size=347K2024.01 | 86.1 | |
| SeeClickModality=Image, Training data size=2.8K2024.01 | 73.6 | |
| WebGUMModality=HTML+Image, Training data size=2.8K2024.01 | 65.5 | |
| MM-WebN-T5Modality=HTML+Image, Training data size=347K2024.01 | 63.4 | |
| WebN-T5Modality=HTML, Training data size=12K2024.01 | 55.2 | |
| CC-Net (SL)Modality=DOM+Image, Training data size=2.4M2024.01 | 35.6 |