Multimodal Reasoning on MuirBench
57.14AccuracyInternVL2
Evaluation results
| Method | Links | |
|---|---|---|
| InternVL2SOFA=true2025.03 | 57.14 | |
| InternVL2SOFA=false2025.03 | 54.53 | |
| VILASOFA=true2025.03 | 52.8 | |
| LLaVA-NeXTSOFA=true2025.03 | 50.43 | |
| VILASOFA=false2025.03 | 48.73 | |
| LLaVA-NeXTSOFA=false2025.03 | 48.22 | |
| MantisSOFA=true2025.03 | 47.64 | |
| FastVToken Retention Ratio=70%2026.05 | 47.4 | |
| SPprunerToken Retention Ratio=70%2026.05 | 47.4 | |
| Idefics2SOFA=true2025.03 | 47.36 | |
| VanillaToken Retention Ratio=100%2026.05 | 47.3 | |
| DARTToken Retention Ratio=70%2026.05 | 47.1 | |
| FastVToken Retention Ratio=50%2026.05 | 47 | |
| SPprunerToken Retention Ratio=50%2026.05 | 47 | |
| DARTToken Retention Ratio=30%2026.05 | 47 | |
| DARTToken Retention Ratio=50%2026.05 | 46.8 | |
| FastVToken Retention Ratio=30%2026.05 | 46.8 | |
| SPprunerToken Retention Ratio=30%2026.05 | 46.8 | |
| MantisSOFA=false2025.03 | 44.28 | |
| Idefics2SOFA=false2025.03 | 42.84 | |
| Random Guessing2025.03 | 21.49 |