Deployment Performance on Task 4
1.236TTFT (s)Phi-4 Mini
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Phi-4 MiniDeployment Device=iPhone 15 Pro Max2025.12 | 1.236 | 1,097 | 8.213 | 3.4 | 3,120.94 | 2.9 | |
| StableLMDeployment Device=iPhone 15 Pro Max2025.12 | 2.708 | 33.5 | 24.473 | 6.3 | 9,299.74 | 4.11 | |
| Qwen-3Deployment Device=iPhone 15 Pro Max2025.12 | 3.042 | 2,930.2 | 4.875 | 1.5 | 1,852.5 | 2.94 | |
| MentaDeployment Device=iPhone 15 Pro Max2025.12 | 3.08 | 2,698.1 | 4.91 | 1.4 | 1,917.2 | 3 |