Multimodal Benchmarking on MMBench (dev)
64.6AccuracyFirebolt-VL
Evaluation results
| Method | Links | |
|---|---|---|
| Firebolt-VLLLM=LFM2, Parameters=0.8B2026.04 | 64.6 | |
| LLaVA-PhiLLM=Phi 2, Parameters=2.7B2026.04 | 59.8 | |
| MobileVLMLLM=Mobile-LLaMA, Parameters=1.7B2026.04 | 59.6 | |
| MoE-LLaVALLM=Qwen, Parameters=2.2B2026.04 | 59.6 | |
| MobileVLM V2LLM=Mobile-LLaMA, Parameters=1.7B2026.04 | 57.7 | |
| IDEFICSLLM=LLaMA, Parameters=9.0B2026.04 | 45.3 |