Mobile Interaction Action Prediction on Mobile Actions
96.09AccuracyCoA
Evaluation results
| Method | Links | |
|---|---|---|
| CoABackbone=Mistral 7B2026.03 | 96.09 | |
| SFTBackbone=Mistral 7B2026.03 | 95.78 | |
| ExtraBackbone=Mistral 7B2026.03 | 95.47 | |
| SFTBackbone=Llama3.1 8B2026.03 | 95.31 | |
| ExtraBackbone=Llama3.1 8B2026.03 | 95.31 | |
| SFTBackbone=Qwen3 1.7B2026.03 | 95.16 | |
| CoABackbone=Llama3.1 8B2026.03 | 95 | |
| ExtraBackbone=Qwen3 1.7B2026.03 | 94.84 | |
| CoABackbone=Qwen3 1.7B2026.03 | 94.53 | |
| PermLMBackbone=Mistral 7B2026.03 | 82.03 | |
| BaseBackbone=Llama3.1 8B2026.03 | 78.12 | |
| PermLMBackbone=Llama3.1 8B2026.03 | 77.97 | |
| sudoLMBackbone=Qwen3 1.7B2026.03 | 69.06 | |
| sudoLMBackbone=Llama3.1 8B2026.03 | 66.56 | |
| BaseBackbone=Mistral 7B2026.03 | 64.06 | |
| BaseBackbone=Qwen3 1.7B2026.03 | 62.03 | |
| sudoLMBackbone=Mistral 7B2026.03 | 56.09 | |
| PermLMBackbone=Qwen3 1.7B2026.03 | 55 |