Trajectory completion judgment on OGRBench Ubuntu
88.7AccuracyStainFlow
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StainFlowVerifier=Gemini-3-Flash2026.06 | 88.7 | 89.4 | |
| StainFlowVerifier=Qwen3.5-27B2026.06 | 87.2 | 88.1 | |
| OS-ThemisVerifier=Qwen3.5-27B2026.06 | 86.8 | 87.2 | |
| ZeroGUIVerifier=Qwen3.5-27B2026.06 | 86.5 | 87.5 | |
| OS-ThemisVerifier=Gemini-3-Flash2026.06 | 86.5 | 87 | |
| StainFlowVerifier=Qwen3.5-9B2026.06 | 85.3 | 86.4 | |
| StainFlowVerifier=GPT-52026.06 | 84.1 | 85.8 | |
| ZeroGUIVerifier=GPT-52026.06 | 81.9 | 83.2 | |
| StainFlowVerifier=Qwen3-VL-8B2026.06 | 81.9 | 84.5 | |
| ZeroGUIVerifier=Gemini-3-Flash2026.06 | 81.8 | 82.6 | |
| ZeroGUIVerifier=Qwen3.5-9B2026.06 | 81.1 | 83.7 | |
| OS-ThemisVerifier=GPT-52026.06 | 79.8 | 78.4 | |
| OS-ThemisVerifier=Qwen3.5-9B2026.06 | 79.4 | 79.1 | |
| ZeroGUIVerifier=Qwen3-VL-8B2026.06 | 79.1 | 82.7 | |
| OS-ThemisVerifier=Qwen3-VL-8B2026.06 | 77.3 | 76.2 | |
| DigiRLVerifier=Gemini-3-Flash2026.06 | 63.9 | 54.2 | |
| DigiRLVerifier=Qwen3.5-27B2026.06 | 62.4 | 51.5 | |
| DigiRLVerifier=GPT-52026.06 | 62.4 | 53 | |
| DigiRLVerifier=Qwen3-VL-8B2026.06 | 60.2 | 50.3 | |
| DigiRLVerifier=Qwen3.5-9B2026.06 | 56.6 | 37.6 |