Web/tool tasks on WebArena 245 (test)
70.4Success RateCVT-RL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CVT-RLDescription=per-seed CVT-RL success, Split (train/dev/test)=1850/230/245, Individual Seeds=68.3/71.5/70.1/69.7/72.42026.06 | 70.4 | 3.5 | |
| IMDescription=information-matched counterfactual-process RL, Split (train/dev/test)=1850/230/2452026.06 | 66.9 | — | |
| CMDescription=compute-matched non-causal RL, Split (train/dev/test)=1850/230/2452026.06 | 62.6 | — |