AITW
Benchmarks
TaskDatasetSOTA resultTrendResults
AITW
67.3Overall Success Rate
38
AITW (test)
78.86Install Success Rate
27
AITW
74.2Action Accuracy
15
AITW Gen
19.5PG
12
AitW WebShopping
68.3SR
6
AitW General
86.5Success Rate
6
AITW SeeClick
62.14Action Match Score (AMS)
5
AITW
7.7Overall Task Time
5
AITW instruction-wise (test)
7.7Overall Error
5
AITW
36.34General Step Accuracy
4
AITW (First 128 task samples)
73.2General Success Rate
2
AITW First 96 task samples
0.723General Success
2