Functionality Grounding on FuncPred
69.5AccuracyGoClick-L
Evaluation Results
| Method | Links | |
|---|---|---|
| GoClick-LSize=0.8B, TTFT ↓ (ms)=91.1, TPOT ↓ (ms/token)=8.32026.04 | 69.5 | |
| GoClick-BSize=0.2B, TTFT ↓ (ms)=37.7, TPOT ↓ (ms/token)=4.12026.04 | 64.4 | |
| OS-ATLAS-8BSize=8B, TTFT ↓ (ms)=137.5, TPOT ↓ (ms/token)=19.92026.04 | 52.1 | |
| AguvisSize=8B, TTFT ↓ (ms)=119.7, TPOT ↓ (ms/token)=21.22026.04 | 52 | |
| UGroundSize=7B, TTFT ↓ (ms)=1034.6, TPOT ↓ (ms/token)=27.92026.04 | 48.8 | |
| OS-ATLAS-4BSize=4B, TTFT ↓ (ms)=137.3, TPOT ↓ (ms/token)=31.42026.04 | 44.6 | |
| ShowUISize=2B, TTFT ↓ (ms)=79.7, TPOT ↓ (ms/token)=14.72026.04 | 39.9 | |
| Qwen2VL-7BSize=8B, TTFT ↓ (ms)=118.9, TPOT ↓ (ms/token)=21.22026.04 | 38.7 | |
| CogAgentSize=18B, TTFT ↓ (ms)=1253.2, TPOT ↓ (ms/token)=208.82026.04 | 29.3 | |
| SeeClickSize=10B, TTFT ↓ (ms)=160.4, TPOT ↓ (ms/token)=184.42026.04 | 19.8 | |
| GPT-4o2026.04 | 9.8 | |
| Qwen2-VLSize=2B, TTFT ↓ (ms)=58.8, TPOT ↓ (ms/token)=16.42026.04 | 7.1 | |
| Ferret-UISize=3B, TTFT ↓ (ms)=69.5, TPOT ↓ (ms/token)=9.82026.04 | 1.3 | |
| Ferret-UISize=8B, TTFT ↓ (ms)=152.5, TPOT ↓ (ms/token)=22.92026.04 | 1.2 |