Function Calling on Mobile Actions (Accuracy)
86.2AccuracyST-Qwen-0.5B
Evaluation results
| Method | Links | |
|---|---|---|
| ST-Qwen-0.5Bevaluation_mode=Fine-tuned2026.02 | 86.2 | |
| FunctionGemmanumber of parameters=270M, evaluation_mode=Fine-tuned2026.02 | 85 | |
| Qwen3-4B-Instructevaluation_mode=Zero-shot2026.02 | 83.7 | |
| ST-Qwen-0.5Bevaluation_mode=Zero-shot2026.02 | 69.3 | |
| FunctionGemmanumber of parameters=270M, evaluation_mode=Zero-shot2026.02 | 58 |