GUI Action Grounding on AndroidControl-Low (test)
93.61Type AccuracyOS-Atlas-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OS-Atlas-7BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 93.61 | 87.97 | 85.22 | |
| SeeClickEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 93 | 73.42 | 75 | |
| Qwen2-VL-7BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 91.94 | 86.5 | 82.56 | |
| OS-Atlas-4BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 91.92 | 83.76 | 80.64 | |
| InternVL-2-4BEvaluation Setting=Supervised Fine-tuning Setting2024.10 | 90.94 | 84.05 | 80.1 | |
| GPT-4oEvaluation Setting=Zero-shot OOD Setting2024.10 | 74.33 | 38.67 | 28.39 | |
| OS-Atlas-7BEvaluation Setting=Zero-shot OOD Setting2024.10 | 73 | 73.37 | 50.94 | |
| OS-Atlas-4BEvaluation Setting=Zero-shot OOD Setting2024.10 | 64.58 | 71.19 | 40.62 |