Open-Ended Generation on MLLMU-Bench (test)
34.5ROUGE-LBase
Evaluation Results
| Method | Links | |
|---|---|---|
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 34.5 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 33.8 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 33.8 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 33.6 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 32.4 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 32.4 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 31.1 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 26.2 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 25.1 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 24.2 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 23.7 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 23.7 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 23.7 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 23.6 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 23.3 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 23.1 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 22.2 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 21.7 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 21.6 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 21.3 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 21.2 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 20.3 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 18.9 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 18.7 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 17.6 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 17.3 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 16.9 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 16.2 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 15.9 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 15.1 |