Short-term planning on OmniAct-Web
95.39Type Success RateSSL-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SSL-7Bmode=Post-Training2026.01 | 95.39 | 77.73 | 77.43 | |
| RL-Continous-7Bmode=Post-Training2026.01 | 93.73 | 76.78 | 76.78 | |
| GUI-R1-7Bmode=Post-Training2026.01 | 91.16 | 77.29 | 77.35 | |
| RL-Binary-7Bmode=Post-Training2026.01 | 91.16 | 75.69 | 75.32 | |
| GUI-R1-3Bmode=Post-Training2026.01 | 88.58 | 75.1 | 75.08 | |
| Os-Atlas-7Bmode=Post-Training2026.01 | 85.63 | 69.35 | 59.15 | |
| SSL-3Bmode=Post-Training2026.01 | 81.95 | 73.45 | 73.39 | |
| QwenVL2.5-7B*mode=Post-Training, SFT=Mix-3K2026.01 | 81.62 | 73.45 | 73.39 | |
| GPT-4omode=Zero Shot2026.01 | 79.33 | 42.79 | 34.06 | |
| QwenVL2.5-7Bmode=Zero Shot2026.01 | 79.15 | 71.32 | 71.21 | |
| RL-Continous-3Bmode=Post-Training2026.01 | 78.92 | 72.56 | 72.21 | |
| RL-Binary-3Bmode=Post-Training2026.01 | 75.98 | 68.85 | 68.6 | |
| UI-R1-3Bmode=Post-Training2026.01 | 75.42 | 61.35 | 61.33 | |
| QwenVL2.5-3B*mode=Post-Training, SFT=Mix-3K2026.01 | 66.24 | 56.91 | 53.02 | |
| QwenVL2.5-3Bmode=Zero Shot2026.01 | 50.63 | 46.89 | 47.02 | |
| Os-Atlas-4Bmode=Post-Training2026.01 | 46.74 | 49.24 | 22.99 |