Trajectory Search on WebArena Lite 1.0 (test)
44.44Shopping SuccessWebArbiter-7B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| WebArbiter-7BPolicy=GPT-4o2026.01 | 44.44 | 42.86 | 52.63 | 56.67 | 49.15 | 14.11 | |
| WebArbiter-7BPolicy=GPT-4o-mini2026.01 | 37.78 | 42.86 | 36.84 | 46.67 | 41.04 | 19.13 | |
| WebShepherd-8BPolicy=GPT-4o2026.01 | 30.43 | 42.86 | 47.62 | 46.88 | 41.95 | 6.91 | |
| GPT-4o-miniPolicy=GPT-4o2026.01 | 26.67 | 37.14 | 42.11 | 40 | 36.48 | 1.44 | |
| WebShepherd-8BPolicy=GPT-4o-mini2026.01 | 26.09 | 45.71 | 23.81 | 40.62 | 34.06 | 9.55 | |
| GPT-4o-miniPolicy=GPT-4o-mini2026.01 | 24.44 | 22.86 | 26.32 | 33.33 | 26.74 | 2.23 | |
| w/o Trajectory SearchPolicy=GPT-4o2026.01 | 23.91 | 31.43 | 28.57 | 56.25 | 35.04 | — | |
| w/o Trajectory SearchPolicy=GPT-4o-mini2026.01 | 21.74 | 22.86 | 19.05 | 34.38 | 24.51 | — |