Model Deployment Efficiency on vivo X100 MediaTek Dimensity 9300
2.7LLM Prefilling LatencyBlueLM-V-3B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BlueLM-V-3BParams=3B, Processor=MediaTek Dimensity 9300, Solution=NPU2024.11 | 2.7 | — | — | |
| MiniCPM-V 2.5Params=8B, Processor=MediaTek Dimensity 9300, Solution=CPU (llama.cpp)2024.11 | 13.9 | 4 | — |