Web Navigation and Tool Use on Web Tool
79.6Task SuccessCVT-RL
Evaluation results
| Method | Links | |
|---|---|---|
| CVT-RLVerifier=yes, Constraints=yes, CF rollouts=semantic, Belief=yes, Compute=3.92026.06 | 79.6 | |
| Information-matched CF processVerifier=yes, Constraints=yes, CF rollouts=semantic, Belief=yes, Compute=3.92026.06 | 76.3 | |
| Compute-matched non-causalVerifier=yes, Constraints=yes, CF rollouts=random extra, Belief=yes, Compute=3.82026.06 | 72 | |
| RLVMRVerifier=yes, Constraints=no, CF rollouts=no, Belief=no, Compute=1.32026.06 | 70.1 | |
| Q-RAGVerifier=yes, Constraints=no, CF rollouts=no, Belief=no, Compute=1.42026.06 | 70 | |
| LongRLVRVerifier=yes, Constraints=no, CF rollouts=no, Belief=no, Compute=1.22026.06 | 69.7 | |
| Constrained process RLVerifier=yes, Constraints=yes, CF rollouts=no, Belief=yes, Compute=1.52026.06 | 69.5 | |
| TROLL-styleVerifier=yes, Constraints=no, CF rollouts=no, Belief=no, Compute=1.12026.06 | 65.7 | |
| PPO-RLVRVerifier=yes, Constraints=no, CF rollouts=no, Belief=no, Compute=1.12026.06 | 60.5 | |
| SFTVerifier=no, Constraints=no, CF rollouts=no, Belief=no, Compute=1.02026.06 | 49.6 |