GUI Action Grounding on AndroidControl High (test)
85.22Type AccuracyOS-Atlas-7B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OS-Atlas-7BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 85.22 | 78.48 | 71.17 | |
| OS-Atlas-4BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 84.69 | 73.79 | 67.54 | |
| InternVL-2-4BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 84.09 | 72.73 | 66.72 | |
| Qwen2-VL-7BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 83.83 | 77.68 | 69.72 | |
| SeeClickEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 82.94 | 62.87 | 59.11 | |
| GPT-4oEvaluation Setting=Zero-shot OOD Setting2024.10 | 63.06 | 30.9 | 21.17 | |
| OS-Atlas-7BEvaluation Setting=Zero-shot OOD Setting2024.10 | 57.44 | 54.9 | 29.83 | |
| OS-Atlas-4BEvaluation Setting=Zero-shot OOD Setting2024.10 | 49.01 | 49.51 | 22.77 |