Multi-modal Capability Evaluation on MMBench (Accuracy and Latency)
58AccuracyQ-Mamba
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Q-MambaQuery Length=7292026.06 | 58 | 7.54 | 0.147 | |
| Q-MambaQuery Length=2562026.06 | 57.7 | 5.94 | 0.099 | |
| Q-MambaQuery Length=5122026.06 | 57.6 | 6.54 | 0.127 | |
| Q-MambaQuery Length=1282026.06 | 57.2 | 5.52 | 0.095 | |
| VL-MambaQuery Length=-2026.06 | 57 | 7.26 | 0.152 | |
| VL-MambaQuery Length=-, Visual scanning order=forward scan only2026.06 | 56.7 | — | — | |
| CobraQuery Length=-2026.06 | 56.2 | 7.62 | 0.129 | |
| VL-MambaQuery Length=-, Visual scanning order=backward scan only2026.06 | 55.9 | — | — |