Deployment Performance on Task 2
1.376TTFT (s)Phi-4 Mini
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Phi-4 MiniDeployment Device=iPhone 15 Pro Max2025.12 | 1.376 | 723.1 | 8.174 | 4.4 | 29,050.4 | 2.58 | |
| StableLMDeployment Device=iPhone 15 Pro Max2025.12 | 2.486 | 38.6 | 22.54 | 6.7 | 80,084.62 | 3.89 | |
| Qwen-3Deployment Device=iPhone 15 Pro Max2025.12 | 4.202 | 2,941.3 | 6.76 | 1.6 | 24,025.04 | 3.03 | |
| MentaDeployment Device=iPhone 15 Pro Max2025.12 | 4.777 | 2,931.6 | 10.885 | 1.9 | 38,685.29 | 3.04 |