Deployment Performance on Task 3
2.333TTFT (s)Phi-4 Mini
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Phi-4 MiniDeployment Device=iPhone 15 Pro Max2025.12 | 2.333 | 1,055.1 | 8.384 | 5.1 | 29,668.79 | 2.58 | |
| StableLMDeployment Device=iPhone 15 Pro Max2025.12 | 2.512 | 38.3 | 22.288 | 6.8 | 79,189.26 | 3.91 | |
| Qwen-3Deployment Device=iPhone 15 Pro Max2025.12 | 4.288 | 4,337.2 | 6.834 | 1.6 | 24,265.29 | 3.03 | |
| MentaDeployment Device=iPhone 15 Pro Max2025.12 | 5.083 | 4,275.4 | 12.837 | 1.8 | 45,622.7 | 3.04 |