List your company
ResearchFormerly WizWand

Verification of Digital Agent Trajectories on VisualWebArena (VWA) and OSWorld

86AccuracyGPT-5
53.7662.1370.578.87Jul 15, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GPT-5SGV=true, Thinking=true2025.0786858721
GPT-o4SGV=true, Thinking=true2025.0784868262
Gemini-2.5-FlashSGV=true, Thinking=true2025.07828978106
GPT-4.1SGV=true, Thinking=false2025.07818778106
GPT-5SGV=false, Thinking=true2025.0781867884
Gemini 2.5 FlashSGV=true, Thinking=false2025.07808876128
GPT-o1SGV=true, Thinking=true2025.07788373137
GPT-o4SGV=false, Thinking=true2025.07788871117
Qwen3-235b-a22bSGV=true, Thinking=true2025.077791711512
Qwen3-32bSGV=true, Thinking=false2025.077688711411
Qwen3-235b-a22bSGV=true, Thinking=false2025.077689701512
GPT-5-NanoSGV=true, Thinking=true2025.07768273106
Gemini-2.5-FlashSGV=false, Thinking=true2025.077492642118
GPT-4.1 MiniSGV=true, Thinking=false2025.077492651714
GPT-4.1SGV=false, Thinking=false2025.077490641915
GPT-5-NanoSGV=false, Thinking=true2025.077284651611
GPT-o1SGV=false, Thinking=true2025.077080622216
Gemini 2.0SGV=true, Thinking=false2025.076994552723
Qwen3-32bSGV=false, Thinking=false2025.076992572521
Gemini 2.5 FlashSGV=false, Thinking=false2025.076894552724
Qwen3-235b-a22bSGV=false, Thinking=true2025.076692532724
Gemini 2.5 LiteSGV=true, Thinking=false2025.076590512925
Qwen3-235b-a22bSGV=false, Thinking=false2025.076593512825
Llama-4-Maverick-17B-128ESGV=true, Thinking=false2025.076589542522
Gemini 2.0SGV=false, Thinking=false2025.076196423634
GPT-4.1 MiniSGV=false, Thinking=false2025.076096403735
Llama-4-Maverick-17B-128ESGV=false, Thinking=false2025.076092443329
Gemini 2.5 LiteSGV=false, Thinking=false2025.075596344139