# Intent Grounding on VWB AG

Source: [Intent Grounding on VWB AG](<https://www.sota2.com/research/sota/intent-grounding-on-vwb-ag>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-28T09:21:36.975Z

Evaluation of Intent Grounding performance on the VWB AG dataset, measured using Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Intent Grounding |
| Dataset (including any stated split) | VWB AG |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/intent-grounding-on-vwb-ag.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| OS-ATLAS-8B | 69.9 | Not recorded | 69f03f2855a3c32af89fa170 |
| Aguvis | 68 | Not recorded | 69f03f2855a3c32af89fa170 |
| GoClick-L | 68 | Not recorded | 69f03f2855a3c32af89fa170 |
| UGround | 63.1 | Not recorded | 69f03f2855a3c32af89fa170 |
| Qwen2VL-7B | 62.1 | Not recorded | 69f03f2855a3c32af89fa170 |
| GoClick-B | 61.2 | Not recorded | 69f03f2855a3c32af89fa170 |
| CogAgent | 59.2 | Not recorded | 69f03f2855a3c32af89fa170 |
| OS-ATLAS-4B | 58.3 | Not recorded | 69f03f2855a3c32af89fa170 |
| ShowUI | 55.3 | Not recorded | 69f03f2855a3c32af89fa170 |
| SeeClick | 27.2 | Not recorded | 69f03f2855a3c32af89fa170 |
| Qwen2-VL | 17.5 | Not recorded | 69f03f2855a3c32af89fa170 |
| GPT-4o | 6.8 | Not recorded | 69f03f2855a3c32af89fa170 |
| Ferret-UI | 1.9 | Not recorded | 69f03f2855a3c32af89fa170 |
| Ferret-UI | 1 | Not recorded | 69f03f2855a3c32af89fa170 |

### OS-ATLAS-8B

Accuracy: 69.9. Result ID: 69f07c1147f34ce924d6adbf.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75791e209131cea68351.md>)

[Implementation](<https://osatlas.github.io/>)

Recorded evaluation configuration: {"Size":"8B","TTFT ↓ (ms)":"137.5","TPOT ↓ (ms/token)":"19.9"}. This record does not assert independent reproduction.

### Aguvis

Accuracy: 68. Result ID: 69f07c1147f34ce924d6adc0.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78581e209131cea77d9c.md>)

Recorded evaluation configuration: {"Size":"8B","TTFT ↓ (ms)":"119.7","TPOT ↓ (ms/token)":"21.2"}. This record does not assert independent reproduction.

### GoClick-L

Accuracy: 68. Result ID: 69f07c1147f34ce924d6adc5.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Implementation](<https://github.com/ZJULiHongxin/GoClick>)

Recorded evaluation configuration: {"Size":"0.8B","TTFT ↓ (ms)":"91.1","TPOT ↓ (ms/token)":"8.3"}. This record does not assert independent reproduction.

### UGround

Accuracy: 63.1. Result ID: 69f07c1147f34ce924d6adbe.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79851e209131cea7dfab.md>)

[Implementation](<https://osu-nlp-group.github.io/UGround/>)

Recorded evaluation configuration: {"Size":"7B","TTFT ↓ (ms)":"1034.6","TPOT ↓ (ms/token)":"27.9"}. This record does not assert independent reproduction.

### Qwen2VL-7B

Accuracy: 62.1. Result ID: 69f07c1147f34ce924d6adba.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75151e209131cea65976.md>)

[Implementation](<https://github.com/QwenLM/Qwen2-VL>)

Recorded evaluation configuration: {"Size":"8B","TTFT ↓ (ms)":"118.9","TPOT ↓ (ms/token)":"21.2"}. This record does not assert independent reproduction.

### GoClick-B

Accuracy: 61.2. Result ID: 69f07c1147f34ce924d6adc6.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Implementation](<https://github.com/ZJULiHongxin/GoClick>)

Recorded evaluation configuration: {"Size":"0.2B","TTFT ↓ (ms)":"37.7","TPOT ↓ (ms/token)":"4.1"}. This record does not assert independent reproduction.

### CogAgent

Accuracy: 59.2. Result ID: 69f07c1147f34ce924d6adbb.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76711e209131cea6d06f.md>)

[Implementation](<https://github.com/THUDM/CogVLM>)

Recorded evaluation configuration: {"Size":"18B","TTFT ↓ (ms)":"1253.2","TPOT ↓ (ms/token)":"208.8"}. This record does not assert independent reproduction.

### OS-ATLAS-4B

Accuracy: 58.3. Result ID: 69f07c1147f34ce924d6adc2.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75791e209131cea68351.md>)

[Implementation](<https://osatlas.github.io/>)

Recorded evaluation configuration: {"Size":"4B","TTFT ↓ (ms)":"137.3","TPOT ↓ (ms/token)":"31.4"}. This record does not assert independent reproduction.

### ShowUI

Accuracy: 55.3. Result ID: 69f07c1147f34ce924d6adc4.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75e41e209131cea6a7f9.md>)

[Implementation](<https://github.com/showlab/ShowUI>)

Recorded evaluation configuration: {"Size":"2B","TTFT ↓ (ms)":"79.7","TPOT ↓ (ms/token)":"14.7"}. This record does not assert independent reproduction.

### SeeClick

Accuracy: 27.2. Result ID: 69f07c1147f34ce924d6adbc.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72441e209131cea55627.md>)

[Implementation](<https://github.com/njucckevin/SeeClick>)

Recorded evaluation configuration: {"Size":"10B","TTFT ↓ (ms)":"160.4","TPOT ↓ (ms/token)":"184.4"}. This record does not assert independent reproduction.

### Qwen2-VL

Accuracy: 17.5. Result ID: 69f07c1147f34ce924d6adc1.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75151e209131cea65976.md>)

[Implementation](<https://github.com/QwenLM/Qwen2-VL>)

Recorded evaluation configuration: {"Size":"2B","TTFT ↓ (ms)":"58.8","TPOT ↓ (ms/token)":"16.4"}. This record does not assert independent reproduction.

### GPT-4o

Accuracy: 6.8. Result ID: 69f07c1147f34ce924d6adb9.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5b7f1e209131ce9c8ef3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Ferret-UI

Accuracy: 1.9. Result ID: 69f07c1147f34ce924d6adbd.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ce1e209131cea58985.md>)

Recorded evaluation configuration: {"Size":"8B","TTFT ↓ (ms)":"152.5","TPOT ↓ (ms/token)":"22.9"}. This record does not assert independent reproduction.

### Ferret-UI

Accuracy: 1. Result ID: 69f07c1147f34ce924d6adc3.

[Reporting paper](<https://www.sota2.com/research/paper/69f03f2855a3c32af89fa170.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ce1e209131cea58985.md>)

Recorded evaluation configuration: {"Size":"3B","TTFT ↓ (ms)":"69.5","TPOT ↓ (ms/token)":"9.8"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
