Intent Grounding on VWB AG
69.9AccuracyOS-ATLAS-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| OS-ATLAS-8BSize=8B, TTFT ↓ (ms)=137.5, TPOT ↓ (ms/token)=19.92026.04 | 69.9 | |
| AguvisSize=8B, TTFT ↓ (ms)=119.7, TPOT ↓ (ms/token)=21.22026.04 | 68 | |
| GoClick-LSize=0.8B, TTFT ↓ (ms)=91.1, TPOT ↓ (ms/token)=8.32026.04 | 68 | |
| UGroundSize=7B, TTFT ↓ (ms)=1034.6, TPOT ↓ (ms/token)=27.92026.04 | 63.1 | |
| Qwen2VL-7BSize=8B, TTFT ↓ (ms)=118.9, TPOT ↓ (ms/token)=21.22026.04 | 62.1 | |
| GoClick-BSize=0.2B, TTFT ↓ (ms)=37.7, TPOT ↓ (ms/token)=4.12026.04 | 61.2 | |
| CogAgentSize=18B, TTFT ↓ (ms)=1253.2, TPOT ↓ (ms/token)=208.82026.04 | 59.2 | |
| OS-ATLAS-4BSize=4B, TTFT ↓ (ms)=137.3, TPOT ↓ (ms/token)=31.42026.04 | 58.3 | |
| ShowUISize=2B, TTFT ↓ (ms)=79.7, TPOT ↓ (ms/token)=14.72026.04 | 55.3 | |
| SeeClickSize=10B, TTFT ↓ (ms)=160.4, TPOT ↓ (ms/token)=184.42026.04 | 27.2 | |
| Qwen2-VLSize=2B, TTFT ↓ (ms)=58.8, TPOT ↓ (ms/token)=16.42026.04 | 17.5 | |
| GPT-4o2026.04 | 6.8 | |
| Ferret-UISize=8B, TTFT ↓ (ms)=152.5, TPOT ↓ (ms/token)=22.92026.04 | 1.9 | |
| Ferret-UISize=3B, TTFT ↓ (ms)=69.5, TPOT ↓ (ms/token)=9.82026.04 | 1 |