Web Navigation on WebArena (test)
63.3Average Task CompletionWebNavigator
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| WebNavigatorModel=Gemini-2.5-Pro, Act #=62026.03 | 63.3 | 62.2 | 53.2 | 51.9 | — | 85.9 | 72.9 | 66.5 | — | — | — | |
| CUGA2026.03 | 61.7 | 61.7 | 64.2 | 58.3 | — | 75.5 | 35.4 | 62.6 | — | — | — | |
| PolySkillFoundation Model=Claude-3.7-Sonnet2025.10 | 59.5 | 62.5 | 27.4 | 58.3 | 63.5 | 80.4 | — | — | — | 25.6 | — | |
| WebNavigatorModel=Claude-Sonnet-4, Act #=62026.03 | 57.1 | 50 | 51.4 | 51.9 | — | 85.9 | 50 | 58.2 | — | — | — | |
| ASIFoundation Model=Claude-3.7-Sonnet2025.10 | 55.8 | 64.2 | 26.7 | 59.1 | 61.3 | 78.5 | — | — | — | 20.1 | — | |
| WebNavigatorModel=GPT-4o, Act #=62026.03 | 49.9 | 42.2 | 51.4 | 44.4 | — | 73.6 | 50 | 48.6 | — | — | — | |
| PolySkillFoundation Model=GPT-4.12025.10 | 49.3 | 54.2 | 18.9 | 51.4 | 54.8 | 73.2 | — | — | — | 18.9 | — | |
| WebNavigatorModel=Qwen3-VL-32B-Instruct, Act #=62026.03 | 47.8 | 50.6 | 44 | 44.9 | — | 75.5 | 43.8 | 45.1 | — | — | — | |
| SkillWeaverFoundation Model=Claude-3.7-Sonnet2025.10 | 47.5 | 55.1 | 19.1 | 46.2 | 52.7 | 72.5 | — | — | — | 16.2 | — | |
| AUTOGUIDEOffline data=true, Context aware=true, Base agent model=GPT-4-turbo, Reflexion=false2024.03 | 47.1 | — | — | — | — | — | — | — | — | — | — | |
| ASIFoundation Model=GPT-4.12025.10 | 46.5 | 46.8 | 21.5 | 46.3 | 53.6 | 73.7 | — | — | — | 15.1 | — | |
| AgentOccamModel=GPT-4-Turbo2026.02 | 45.7 | 38.9 | 52.3 | 43.3 | — | 67 | — | 46.2 | — | — | — | |
| Plan-and-ActModel=Llama-70B, Act #=8, finetuned=true2026.03 | 45.7 | — | — | — | — | — | — | — | — | — | — | |
| BaselineFoundation Model=Claude-3.7-Sonnet2025.10 | 45.6 | 46.7 | 18.3 | 44.7 | 50.8 | 70.2 | — | — | — | 12.1 | — | |
| CLAUDE-3.7-SONNETModel Category=Closed Models2025.06 | 45.4 | 52 | 47.7 | 37 | 37.4 | 58.8 | — | — | — | — | — | |
| PolySkillFoundation Model=Qwen3-Coder-480B-A35B-Instruct2025.10 | 45.2 | 46.1 | 17.1 | 44.4 | 46.3 | 64.2 | — | — | — | 16.8 | — | |
| ASIFoundation Model=Qwen3-Coder-480B-A35B-Instruct2025.10 | 43.9 | 47.2 | 16.7 | 45.1 | 44.8 | 63.5 | — | — | — | 13.1 | — | |
| SkillWeaverFoundation Model=GPT-4.12025.10 | 43.6 | 50.3 | 17.2 | 39.3 | 48.2 | 71.2 | — | — | — | 16.3 | — | |
| AgentOccamModel=GPT-4-Turbo, Act #=82026.03 | 43.1 | 37.8 | 46.8 | 40.6 | — | 61.3 | 14.6 | 45.6 | — | — | — | |
| AgentOccamModel=GPT-4o, Act #=8, reproduced=true2026.03 | 42.9 | 44.4 | 40.4 | 33.7 | — | 60.4 | 25 | 46.7 | — | — | — | |
| PolySkillFoundation Model=GLM-4.52025.10 | 39.8 | 41.6 | 17.8 | 39.4 | 44.5 | 63.2 | — | — | — | 13 | — | |
| PLAN-MCTSModel=GPT-4o2026.02 | 39.2 | 33.7 | 24.6 | 43.6 | — | 54.1 | — | 40.5 | — | — | — | |
| Hybrid AgentBase LLM=GPT-4o, Task Specificity=task-agnostic2024.10 | 38.9 | 44.4 | 45.9 | 25.7 | 41.2 | 51.9 | 16.7 | — | — | — | — | |
| ASIFoundation Model=GLM-4.52025.10 | 38.9 | 40.8 | 17.3 | 38.6 | 43.7 | 62.5 | — | — | — | 12.1 | — | |
| AgentHER-MJBackbone=Qwen-72B2026.03 | 38.9 | — | — | — | — | — | — | — | — | — | — | |
| BaselineFoundation Model=GPT-4.12025.10 | 38.5 | 38.9 | 16.4 | 37.4 | 44 | 66 | — | — | — | 10.3 | — | |
| RL-HybridReward-ZeroBackbone=Qwen3-VL-32B-Thinking2026.02 | 38.1 | 35.4 | 42.3 | 40 | — | 36.1 | — | 37.6 | — | — | — | |
| SkillWeaverFoundation Model=Qwen3-Coder-480B-A35B-Instruct2025.10 | 38.1 | 38.5 | 12.7 | 31.3 | 36.1 | 58.7 | — | — | — | 11.4 | — | |
| AgentHER-SJBackbone=Qwen-72B2026.03 | 38.1 | — | — | — | — | — | — | — | — | — | — | |
| GPT-4OModel Category=Closed Models2025.06 | 37.6 | 36.7 | 37.5 | 32.3 | 35.7 | 50.9 | — | — | — | — | — | |
| WebPilotModel=GPT-4o2026.02 | 37.2 | 39.4 | 33.9 | 36.9 | — | 64.1 | — | 24.7 | — | — | — | |
| WebPilotModel=GPT-4o2026.03 | 37.2 | 39.4 | 33.9 | 36.9 | — | 65.1 | — | 24.7 | — | — | — | |
| CERmode=hybrid2025.06 | 36.7 | 37.2 | 30.4 | 32.8 | — | — | — | 41.2 | 41.2 | — | — | |
| CERModel=GPT-4o2026.02 | 36.7 | 37.2 | 30.4 | 32.8 | — | 41.2 | — | 41.2 | — | — | — | |
| StePTask Specificity=specifically inspired by WebArena tasks2024.10 | 36.5 | 32.2 | 31.2 | 50.8 | 23.6 | 57.5 | 10.4 | — | — | — | — | |
| BaselineFoundation Model=GLM-4.52025.10 | 36.2 | 37.5 | 15.7 | 36.1 | 40.9 | 59.4 | — | — | — | 10 | — | |
| Branch-and-BrowseModel=GPT-4o2026.02 | 35.8 | 36.7 | 46.8 | 34.6 | — | 50.9 | — | 26.4 | — | — | — | |
| Branch and browseModel=GPT-4o, Act #=122026.03 | 35.8 | 36.7 | 46.8 | 34.6 | — | 50.9 | 18.8 | 26.4 | — | — | — | |
| AWMTask Specificity=task-agnostic2024.10 | 35.5 | 35 | 42.2 | 32.1 | 29.1 | 54.7 | 18.8 | — | — | — | — | |
| AWMModel=GPT-4-Turbo2026.02 | 35.5 | 35 | 42.2 | 32.1 | — | 54.7 | — | 29.1 | — | — | — | |
| R-WoMModel=Claude-3.7-Sonnet2025.10 | 34.58 | — | — | — | — | — | — | — | — | — | — | |
| BaselineFoundation Model=Qwen3-Coder-480B-A35B-Instruct2025.10 | 34.4 | 27.7 | 10.5 | 28.1 | 31.2 | 52.4 | — | — | — | 6.8 | — | |
| SkillWeaverFoundation Model=GLM-4.52025.10 | 33.6 | 39.1 | 16.4 | 34.2 | 39.7 | 54.8 | — | — | — | 11.2 | — | |
| CERmode=offline2025.06 | 33.4 | 36.7 | 29.5 | 29.2 | — | — | — | 36.8 | 33.3 | — | — | |
| StePModel=GPT-4-Turbo2026.02 | 33.3 | 26.7 | 35.8 | 33.2 | — | 52.8 | — | 32.4 | — | — | — | |
| CERmode=online2025.06 | 33.2 | 34.2 | 28.6 | 29.2 | — | — | — | 36.3 | 37.7 | — | — | |
| R-WoMModel=Claude-3.5-Sonnet2025.10 | 33.15 | — | — | — | — | — | — | — | — | — | — | |
| StePHuman-designed detailed policies=true2025.06 | 33 | 32 | 30 | 37 | — | — | — | 24 | 59 | — | — | |
| StePModel=GPT-4-Turbo, Act #=272026.03 | 33 | 32 | 30 | 37 | — | 59 | — | 24 | — | — | — | |
| RAGModel=Claude-3.7-Sonnet2025.10 | 32.75 | — | — | — | — | — | — | — | — | — | — | |
| WebDreamerModel=Claude-3.7-Sonnet2025.10 | 31.86 | — | — | — | — | — | — | — | — | — | — | |
| BrowsergymModel=GPT-4o, Act #=202026.03 | 31.4 | — | — | — | — | — | — | — | — | — | — | |
| SFT-SuccessBackbone=Qwen-72B2026.03 | 30.8 | — | — | — | — | — | — | — | — | — | — | |
| RAGModel=Claude-3.5-Sonnet2025.10 | 30.7 | — | — | — | — | — | — | — | — | — | — | |
| AgentHER-MJBackbone=GPT-4o2026.03 | 30.5 | — | — | — | — | — | — | — | — | — | — | |
| WebDreamerModel=Claude-3.5-Sonnet2025.10 | 29.82 | — | — | — | — | — | — | — | — | — | — | |
| AgentHER-SJBackbone=GPT-4o2026.03 | 29.7 | — | — | — | — | — | — | — | — | — | — | |
| Rejection-SamplingBackbone=Qwen-72B2026.03 | 29.4 | — | — | — | — | — | — | — | — | — | — | |
| API-Based AgentBase LLM=GPT-4o, Task Specificity=task-agnostic2024.10 | 29.2 | 43.9 | 45.4 | 25.1 | 20.3 | 18.9 | 8.3 | — | — | — | — | |
| VanillaModel=Claude-3.7-Sonnet2025.10 | 28.92 | — | — | — | — | — | — | — | — | — | — | |
| R-WoMModel=Qwen-2.5-VL-72B2025.10 | 28.49 | — | — | — | — | — | — | — | — | — | — | |
| ReflexionBackbone=Qwen-72B, Mode=Inference-time/online2026.03 | 28.1 | — | — | — | — | — | — | — | — | — | — | |
| AgentHER-MJBackbone=Qwen-7B2026.03 | 27.8 | — | — | — | — | — | — | — | — | — | — | |
| VanillaModel=Claude-3.5-Sonnet2025.10 | 27.74 | — | — | — | — | — | — | — | — | — | — | |
| BaselineBackbone=Qwen3-VL-32B-Thinking2026.02 | 27.4 | 30 | 8.2 | 30.7 | — | 28.3 | — | 34.1 | — | — | — | |
| R2D22025.01 | 27.3 | 28 | 28 | 36 | — | 21 | — | 30 | — | — | — | |
| AgentHER-SJBackbone=Qwen-7B2026.03 | 27 | — | — | — | — | — | — | — | — | — | — | |
| AutoEvalTask Specificity=task-agnostic2024.10 | 26.9 | 25 | 27.5 | 39.6 | 20.9 | 20.8 | 16.7 | — | — | — | — | |
| AutoEvalModel=GPT-42026.02 | 26.9 | 25 | 27.5 | 39.6 | — | 20.8 | — | 20.9 | — | — | — | |
| SFT-RandomBackbone=Qwen-72B, Data control=Equal-volume (3,000 failed trajectories)2026.03 | 26.3 | — | — | — | — | — | — | — | — | — | — | |
| TTIBackbone=Gemma 3 12B2026.02 | 26.1 | 15.7 | 40.5 | 33.9 | — | 35.3 | — | 15.5 | — | — | — | |
| AgentHER-MJBackbone=LLaMA-8B2026.03 | 26.1 | — | — | — | — | — | — | — | — | — | — | |
| AgentHER-SJBackbone=LLaMA-8B2026.03 | 25.3 | — | — | — | — | — | — | — | — | — | — | |
| GPT-4.1Train on=-2025.11 | 25.22 | 26.79 | 21.9 | 30.91 | — | 15.38 | — | 24.56 | — | — | — | |
| WebDreamerModel=Qwen-2.5-VL-72B2025.10 | 24.5 | — | — | — | — | — | — | — | — | — | — | |
| BrowserGymbackbone=GPT-4o, reproduced=true2025.06 | 24.3 | 21.4 | 18.4 | 26.6 | — | — | — | 28 | 22.8 | — | — | |
| BrowserGymModel=GPT-4o2026.02 | 24.3 | 21.4 | 18.4 | 26.6 | — | 22.8 | — | 28 | — | — | — | |
| Learn-by-InteractBackbone=Codestral 22B2026.02 | 24.2 | — | — | — | — | — | — | — | — | — | — | |
| BrowserGymBase Model=GPT-42025.01 | 23.5 | — | — | — | — | — | — | — | — | — | — | |
| UI-TARS + SFTTrain on=Test Dataset2025.11 | 23.45 | 21.43 | 28.12 | 25.45 | — | 19.23 | — | 22.81 | — | — | — | |
| ARBase Model=GPT-42025.01 | 23.4 | 18 | 27 | 32 | — | 24 | — | 16 | — | — | — | |
| SFT-SuccessBackbone=GPT-4o2026.03 | 23.4 | — | — | — | — | — | — | — | — | — | — | |
| LATSBase Model=GPT-42025.01 | 22.5 | 17 | 27 | 30 | — | 25 | — | 15 | — | — | — | |
| RAGModel=Qwen-2.5-VL-72B2025.10 | 22.42 | — | — | — | — | — | — | — | — | — | — | |
| AgentTrekBackbone=Qwen2.5 32B2026.02 | 22.4 | — | — | — | — | — | — | — | — | — | — | |
| VanillaModel=Qwen-2.5-VL-72B2025.10 | 21.84 | — | — | — | — | — | — | — | — | — | — | |
| ExpeLOffline data=true, Context aware=false, Base agent model=GPT-4-turbo, Reflexion=false2024.03 | 21.8 | — | — | — | — | — | — | — | — | — | — | |
| Rejection-SamplingBackbone=GPT-4o2026.03 | 21.8 | — | — | — | — | — | — | — | — | — | — | |
| GO-BROWSE-7BModel Category=Open-weights 7B Models, Parameter Scale=7B2025.06 | 21.7 | 15.3 | 17.9 | 22.4 | 25.3 | 30.7 | — | — | — | — | — | |
| BaseBackbone=Qwen-72B2026.03 | 21.4 | — | — | — | — | — | — | — | — | — | — | |
| WebarenaModel=GPT-4o, Act #=12, reproduced=true2026.03 | 21.1 | 22.2 | 18.4 | 24.6 | — | 22.6 | 8.3 | 20.3 | — | — | — | |
| Qwen + SynthAgentTrain on=Synthetic Data2025.11 | 20.8 | 19.64 | 28.12 | 20 | — | 15.38 | — | 21.05 | — | — | — | |
| AutoEvalBase Model=GPT-42025.01 | 20.2 | — | — | — | — | — | — | — | — | — | — | |
| AutoEval2025.06 | 20.2 | 28.6 | 31.9 | 25.5 | — | — | — | 18.1 | 25.4 | — | — | |
| Auto-EvalModel=GPT-4-Preview, Act #=122026.03 | 20.2 | — | — | — | — | — | — | — | — | — | — | |
| GPT-4O-MINIModel Category=Closed Models2025.06 | 19.3 | 20.9 | 15.6 | 19.3 | 19.2 | 21.1 | — | — | — | — | — | |
| Search AgentModel=GPT-4o2026.02 | 19.2 | 13.9 | 26.6 | 27.8 | — | 11.3 | — | 16.5 | — | — | — | |
| Tree searchModel=GPT-4o, Act #=122026.03 | 19.2 | 13.3 | 25.8 | 28.1 | — | 10.5 | — | 16.5 | — | — | — | |
| ReflexionBackbone=GPT-4o, Mode=Inference-time/online2026.03 | 19.1 | — | — | — | — | — | — | — | — | — | — | |
| Tree-SearchBase Model=GPT-4o2025.01 | 19 | 13 | 26 | 28 | — | 11 | — | 17 | — | — | — |