Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

GUI Agent Task research benchmarks · SOTA2 Research

GUI Agent Task

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

80Success Rate

200

Jul 1, 2026

MemGUI-Bench (Overall)

MemGUI-Agent-235B

37.5Precision@1

19

Jun 19, 2026

MemGUI-Bench Hard

MemGUI-Agent-235B

34.2P@1

19

Jun 19, 2026

MemGUI-Bench Medium

35.7Precision@1

19

Jun 19, 2026

MemGUI-Bench Easy

41.7P@1

19

Jun 19, 2026

88.6Success Rate

9

May 13, 2026

Mind2Web (live)

SeeAct-V + GPT-4o + UGround

50.8Completion Rate

4

Feb 26, 2026

OSWORLD noisy (Overall)

UI-TARS-1.5-7B + ENVS

29Pass@8 Success Rate

3

Jun 23, 2026

OSWORLD noisy (Held-out)

UI-TARS-1.5-7B + ARPO

5.1Pass@8 Success Rate

3

Jun 23, 2026

OSWORLD noisy (Trained (86))

UI-TARS-1.5-7B + ENVS

88.4Pass@8 Success Rate

3

Jun 23, 2026

OSWORLD clean (Overall)

UI-TARS-1.5-7B + ENVS

30.3Pass@8 Success Rate

3

Jun 23, 2026

OSWORLD clean (held-out)

UI-TARS-1.5-7B + ENVS

7.5Pass@8 Success Rate

3

Jun 23, 2026

OSWORLD clean (Trained (86))

UI-TARS-1.5-7B + ENVS

87.2pass@8 Success Rate

3

Jun 23, 2026

WebArena Reddit

0.95Success Rate

2

Feb 26, 2026

Popular datasets

OSWorld MemGUI-Bench Mind2Web AndroidWorld WebArena

Follow for updates

Join SOTA2 Contact