Intent Grounding on MOTIF
80.4AccuracyGoClick-L
Evaluation Results
| Method | Links | |
|---|---|---|
| GoClick-LSize=0.8B, TTFT ↓ (ms)=91.1, TPOT ↓ (ms/token)=8.32026.04 | 80.4 | |
| OS-ATLAS-8BSize=8B, TTFT ↓ (ms)=137.5, TPOT ↓ (ms/token)=19.92026.04 | 78.8 | |
| GoClick-BSize=0.2B, TTFT ↓ (ms)=37.7, TPOT ↓ (ms/token)=4.12026.04 | 76.8 | |
| OS-ATLAS-4BSize=4B, TTFT ↓ (ms)=137.3, TPOT ↓ (ms/token)=31.42026.04 | 75.4 | |
| Qwen2VL-7BSize=8B, TTFT ↓ (ms)=118.9, TPOT ↓ (ms/token)=21.22026.04 | 75.1 | |
| AguvisSize=8B, TTFT ↓ (ms)=119.7, TPOT ↓ (ms/token)=21.22026.04 | 73.8 | |
| UGroundSize=7B, TTFT ↓ (ms)=1034.6, TPOT ↓ (ms/token)=27.92026.04 | 72.4 | |
| ShowUISize=2B, TTFT ↓ (ms)=79.7, TPOT ↓ (ms/token)=14.72026.04 | 72.3 | |
| CogAgentSize=18B, TTFT ↓ (ms)=1253.2, TPOT ↓ (ms/token)=208.82026.04 | 46.7 | |
| GPT-4o2026.04 | 30.5 | |
| Qwen2-VLSize=2B, TTFT ↓ (ms)=58.8, TPOT ↓ (ms/token)=16.42026.04 | 28.8 | |
| Ferret-UISize=8B, TTFT ↓ (ms)=152.5, TPOT ↓ (ms/token)=22.92026.04 | 15.9 | |
| SeeClickSize=10B, TTFT ↓ (ms)=160.4, TPOT ↓ (ms/token)=184.42026.04 | 11.1 | |
| Ferret-UISize=3B, TTFT ↓ (ms)=69.5, TPOT ↓ (ms/token)=9.82026.04 | 5.5 |