Reward Verification on AgentRewardBench VisualWebArena
100PrecisionRule-based (VWA Oracle)
Evaluation results
| Method | Links | |
|---|---|---|
| Rule-based (VWA Oracle)version=ours2025.07 | 100 | |
| SGVbackbone=GPT-o42025.07 | 86 | |
| Rule-based (VWA Oracle)version=original2025.07 | 85 | |
| SGVbackbone=Gemini 2.5, mode=no Thinking2025.07 | 80 | |
| No-SGV Baselinebackbone=GPT-o42025.07 | 80 | |
| WebJudgebackbone=GPT-o4, status=SOTA2025.07 | 75 | |
| No-SGV Baselinebackbone=Gemini 2.5, mode=no Thinking2025.07 | 73 |