WorkArena
Benchmarks
TaskDatasetSOTA resultTrendResults
WorkArena L2
4.7Success Rate
18
WorkArena L1
38.8Success Rate
18
WorkArena Held-out Tasks (test)
70Success Rate
16
WorkArena Held-out Goals (test)
53.8Success Rate
16
WorkArena L1
79.7Task Success Rate
14
WorkArena
84.33Pairwise Accuracy
13
WorkArena L1
79.1Success Rate
12
WorkArena
0.01Average Wall-Clock Time (seconds)
11
WorkArena L2 147-task (test)
40Success Rate
10
WorkArena L1 (full)
79.4Success Rate
10
WorkArena-NLP
40.6Field Accuracy
9
WorkArena++ L2
41.6Success Rate
9
WorkArena L1
68Average Reward
8
WorkArena (test)
45.1M&D Score
7
WorkArena L2
6.8Success Rate
5
WorkArena-L1 (test)
55.56Success Rate (SR)
4
WorkArena L1
0.803Cumulative Runtime (h/m)
3
WorkArena L2 full benchmark
69.4Success Rate
3
WorkArena L2 (test)
9.7Success Rate
2