# Mobile Agent Navigation on GUI Odyssey 1.0 (test)

Source: [Mobile Agent Navigation on GUI Odyssey 1.0 (test)](<https://www.sota2.com/research/sota/mobile-agent-navigation-on-gui-odyssey-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:47.408Z

Evaluation of mobile agent navigation performance on the test split of GUI Odyssey version 1.0, reporting metrics including type accuracy, grounding accuracy, and step success rate.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Mobile Agent Navigation |
| Dataset (including any stated split) | GUI Odyssey 1.0 (test) |
| Metric | Step Success Rate (SR) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Step Success Rate (SR)](<https://www.sota2.com/research/sota/mobile-agent-navigation-on-gui-odyssey-1-0-test.md?metric=Step%20Success%20Rate%20(SR)>): Higher is better; unit: PERCENT.

- [Type Accuracy](<https://www.sota2.com/research/sota/mobile-agent-navigation-on-gui-odyssey-1-0-test.md?metric=Type%20Accuracy>): Higher is better; unit: PERCENT.

- [Grounding Accuracy](<https://www.sota2.com/research/sota/mobile-agent-navigation-on-gui-odyssey-1-0-test.md?metric=Grounding%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Step Success Rate (SR) | Result date | Report paper |
| --- | --- | --- | --- |
| ADPO | 81.7 | Not recorded | 695c96e653fdd5c36174346e |
| ADPO | 81.6 | Not recorded | 695c96e653fdd5c36174346e |
| GRPO | 81.5 | Not recorded | 695c96e653fdd5c36174346e |
| ADPO | 81.4 | Not recorded | 695c96e653fdd5c36174346e |
| GRPO | 81.3 | Not recorded | 695c96e653fdd5c36174346e |
| GRPO | 81.1 | Not recorded | 695c96e653fdd5c36174346e |
| GRPO | 79.8 | Not recorded | 695c96e653fdd5c36174346e |
| ADPO | 79.7 | Not recorded | 695c96e653fdd5c36174346e |
| SpiritSight-8B | 75.8 | Not recorded | 695c96e653fdd5c36174346e |
| AgentCPM-GUI-8B | 75 | Not recorded | 695c96e653fdd5c36174346e |
| UI-TARS-7B | 67.9 | Not recorded | 695c96e653fdd5c36174346e |
| Qwen2.5-VL-7B (Base) | 52.8 | Not recorded | 695c96e653fdd5c36174346e |
| Qwen2.5-VL-7B (Base) | 46.9 | Not recorded | 695c96e653fdd5c36174346e |
| Qwen2.5-VL-7B (Base) | 46.6 | Not recorded | 695c96e653fdd5c36174346e |
| Qwen2.5-VL-7B (Base) | 46.5 | Not recorded | 695c96e653fdd5c36174346e |

### ADPO

Step Success Rate (SR): 81.7. Result ID: 6997ecc95698665ec445fe8d.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

Recorded evaluation configuration: {"Number of samples (N)":8}. This record does not assert independent reproduction.

### ADPO

Step Success Rate (SR): 81.6. Result ID: 6997ecc95698665ec445fe8a.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

Recorded evaluation configuration: {"Number of samples (N)":4}. This record does not assert independent reproduction.

### GRPO

Step Success Rate (SR): 81.5. Result ID: 6997ecc95698665ec445fe8c.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Number of samples (N)":8}. This record does not assert independent reproduction.

### ADPO

Step Success Rate (SR): 81.4. Result ID: 6997ecc95698665ec445fe90.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

Recorded evaluation configuration: {"Number of samples (N)":12}. This record does not assert independent reproduction.

### GRPO

Step Success Rate (SR): 81.3. Result ID: 6997ecc95698665ec445fe89.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Number of samples (N)":4}. This record does not assert independent reproduction.

### GRPO

Step Success Rate (SR): 81.1. Result ID: 6997ecc95698665ec445fe8f.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Number of samples (N)":12}. This record does not assert independent reproduction.

### GRPO

Step Success Rate (SR): 79.8. Result ID: 6997ecc95698665ec445fe86.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73101e209131cea5a395.md>)

[Implementation](<https://github.com/deepseek-ai/DeepSeek-Math>)

Recorded evaluation configuration: {"Number of samples (N)":1}. This record does not assert independent reproduction.

### ADPO

Step Success Rate (SR): 79.7. Result ID: 6997ecc95698665ec445fe87.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

Recorded evaluation configuration: {"Number of samples (N)":1}. This record does not assert independent reproduction.

### SpiritSight-8B

Step Success Rate (SR): 75.8. Result ID: 6997ecc95698665ec445fe83.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78041e209131cea765a6.md>)

[Implementation](<https://hzhiyuan.github.io/SpiritSight-Agent>)

Recorded evaluation configuration: {"Number of samples (N)":1}. This record does not assert independent reproduction.

### AgentCPM-GUI-8B

Step Success Rate (SR): 75. Result ID: 6997ecc95698665ec445fe84.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79861e209131cea7e031.md>)

Recorded evaluation configuration: {"Number of samples (N)":1}. This record does not assert independent reproduction.

### UI-TARS-7B

Step Success Rate (SR): 67.9. Result ID: 6997ecc95698665ec445fe82.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76a61e209131cea6e2ba.md>)

Recorded evaluation configuration: {"Number of samples (N)":1}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B (Base)

Step Success Rate (SR): 52.8. Result ID: 6997ecc95698665ec445fe85.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Number of samples (N)":1}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B (Base)

Step Success Rate (SR): 46.9. Result ID: 6997ecc95698665ec445fe8e.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Number of samples (N)":12}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B (Base)

Step Success Rate (SR): 46.6. Result ID: 6997ecc95698665ec445fe8b.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Number of samples (N)":8}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B (Base)

Step Success Rate (SR): 46.5. Result ID: 6997ecc95698665ec445fe88.

[Reporting paper](<https://www.sota2.com/research/paper/695c96e653fdd5c36174346e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Number of samples (N)":4}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
