Multimodal Inference Latency on ScienceQA IMG
919.25Throughput (token/s)MobileVLM-1.7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MobileVLM-1.7BModel Size=1.7B2024.05 | 919.25 | 579.88 | |
| Xmodel-VLMModel Size=1.1B2024.05 | 415.69 | 1,360.25 | |
| LLaVA-7BModel Size=7B2024.05 | 19.06 | 1,090.32 |