Trajectory completion judgment on OGRBench (Overall)
88.2AccuracyStainFlow
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| StainFlowVerifier=Gemini-3-Flash2026.06 | 88.2 | 87.5 | 89 | 88.2 | |
| StainFlowVerifier=Qwen3.5-27B2026.06 | 87.4 | 86.4 | 88.6 | 87.5 | |
| OS-ThemisVerifier=Gemini-3-Flash2026.06 | 86.6 | 88.4 | 84.1 | 86.2 | |
| OS-ThemisVerifier=Qwen3.5-27B2026.06 | 86.4 | 89 | 83 | 85.6 | |
| StainFlowVerifier=Qwen3.5-9B2026.06 | 84.7 | 83.8 | 85.7 | 84.8 | |
| ZeroGUIVerifier=Qwen3.5-27B2026.06 | 84.5 | 82.2 | 87.9 | 84.9 | |
| StainFlowVerifier=GPT-52026.06 | 83.5 | 80.6 | 88 | 84.2 | |
| ZeroGUIVerifier=GPT-52026.06 | 81.9 | 80.6 | 83.7 | 82.1 | |
| ZeroGUIVerifier=Gemini-3-Flash2026.06 | 81.5 | 80.1 | 83.6 | 81.8 | |
| StainFlowVerifier=Qwen3-VL-8B2026.06 | 81.1 | 75.5 | 91.9 | 82.9 | |
| OS-ThemisVerifier=Qwen3.5-9B2026.06 | 80.7 | 86.3 | 72.7 | 78.9 | |
| ZeroGUIVerifier=Qwen3.5-9B2026.06 | 80.1 | 76.9 | 85.7 | 81.1 | |
| OS-ThemisVerifier=GPT-52026.06 | 80.1 | 89.9 | 67.4 | 77.1 | |
| OS-ThemisVerifier=Qwen3-VL-8B2026.06 | 79.1 | 84.9 | 70.4 | 77 | |
| ZeroGUIVerifier=Qwen3-VL-8B2026.06 | 77 | 69.8 | 94.7 | 80.4 | |
| DigiRLVerifier=Gemini-3-Flash2026.06 | 69.4 | 80.7 | 50.4 | 62 | |
| DigiRLVerifier=GPT-52026.06 | 67.2 | 78.1 | 47.3 | 58.9 | |
| DigiRLVerifier=Qwen3.5-27B2026.06 | 67.1 | 80.5 | 44.7 | 57.5 | |
| DigiRLVerifier=Qwen3-VL-8B2026.06 | 66 | 76 | 46.1 | 57.4 | |
| DigiRLVerifier=Qwen3.5-9B2026.06 | 62.2 | 81.1 | 31.3 | 45.2 |