Question Answering on MLLMU-Bench 1.0 (Retain)
58.6AccuracyVanilla
Evaluation results
| Method | Links | |
|---|---|---|
| VanillaBackbone=Qwen2-VL-7B2025.12 | 58.6 | |
| GABackbone=Qwen2-VL-7B2025.12 | 57.6 | |
| Visual Knowledge DistillationBackbone=Qwen2-VL-7B2025.12 | 56.4 | |
| MMUBackbone=Qwen2-VL-7B2025.12 | 55.7 | |
| KL MinBackbone=Qwen2-VL-7B2025.12 | 55.6 | |
| GA DiffBackbone=Qwen2-VL-7B2025.12 | 54.4 | |
| NPOBackbone=Qwen2-VL-7B2025.12 | 53.3 | |
| MANUBackbone=Qwen2-VL-7B2025.12 | 49.4 | |
| VanillaBackbone=LLaVA-1.5-7B2025.12 | 37.5 | |
| Visual Knowledge DistillationBackbone=LLaVA-1.5-7B2025.12 | 36.1 | |
| MMUBackbone=LLaVA-1.5-7B2025.12 | 35.1 | |
| GABackbone=LLaVA-1.5-7B2025.12 | 32.2 | |
| NPOBackbone=LLaVA-1.5-7B2025.12 | 32.2 | |
| MANUBackbone=LLaVA-1.5-7B2025.12 | 32.1 | |
| KL MinBackbone=LLaVA-1.5-7B2025.12 | 32 | |
| GA DiffBackbone=LLaVA-1.5-7B2025.12 | 31.5 |