Deployment Performance on Task 1
1.239TTFT (s)Phi-4 Mini
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Phi-4 MiniDeployment Device=iPhone 15 Pro Max2025.12 | 1.239 | 870.8 | 8.148 | 5.4 | 5,834.33 | 2.58 | |
| StableLMDeployment Device=iPhone 15 Pro Max2025.12 | 2.599 | 37.5 | 23.2 | 6.6 | 16,541.6 | 4.77 | |
| Qwen-3Deployment Device=iPhone 15 Pro Max2025.12 | 3.705 | 3,516.5 | 5.193 | 1.9 | 3,718.19 | 2.94 | |
| MentaDeployment Device=iPhone 15 Pro Max2025.12 | 4.024 | 3,587 | 6.335 | 1.8 | 4,535.86 | 2.99 |