Deployment Performance on Task 5
1.287TTFT (s)Phi-4 Mini
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Phi-4 MiniDeployment Device=iPhone 15 Pro Max2025.12 | 1.287 | 1,041.5 | 8.656 | 5.1 | 4,328 | 2.59 | |
| StableLMDeployment Device=iPhone 15 Pro Max2025.12 | 2.431 | 37.4 | 24.104 | 6.3 | 12,052 | 3.52 | |
| MentaDeployment Device=iPhone 15 Pro Max2025.12 | 6.005 | 6,031.4 | 27.657 | 1.3 | 13,828.5 | 3.04 | |
| Qwen-3Deployment Device=iPhone 15 Pro Max2025.12 | 6.966 | 5,550 | 25.428 | 1.3 | 12,650.3 | 2.95 |