Task Success on OSWorld (test)
25Chrome Success RateCompressed-a11y
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Compressed-a11y2026.05 | 25 | 23.1 | 4.3 | 19.1 | 30.4 | 10.8 | 37.5 | 46.7 | 29.4 | 34.8 | 20.7 | |
| Linearized a11y tree2026.05 | 18.2 | 19.2 | 0 | 14.9 | 8.7 | 10.8 | 33.3 | 26.7 | 29.4 | 30.4 | 15.6 | |
| LineRetriever2026.05 | 13.6 | 19.2 | 2.2 | 19.1 | 8.7 | 10.8 | 33.3 | 13.3 | 17.6 | 34.8 | 15.1 | |
| Screenshot2026.05 | 4.5 | 11.5 | 0 | 2.1 | 4.3 | 10.8 | 20.8 | 0 | 11.8 | 4.3 | 7 |