Deployment Performance on Task 6
1.227TTFT (s)Phi-4 Mini
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Phi-4 MiniDeployment Device=iPhone 15 Pro Max2025.12 | 1.227 | 1,063.4 | 7.296 | 6 | 3,648 | 2.59 | |
| StableLMDeployment Device=iPhone 15 Pro Max2025.12 | 2.51 | 36.9 | 23.1 | 6.4 | 11,500 | 3.53 | |
| MentaDeployment Device=iPhone 15 Pro Max2025.12 | 5.741 | 5,851.4 | 19.883 | 1.3 | 9,941.5 | 2.94 | |
| Qwen-3Deployment Device=iPhone 15 Pro Max2025.12 | 6.904 | 5,416.7 | 27.509 | 1.4 | 13,754.5 | 3.04 |