Open-Ended Generation on MLLMU-Bench (Retain Set)
53.1ROUGE-LPO
Evaluation Results
| Method | Links | |
|---|---|---|
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 53.1 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 52.9 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 52.6 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 52.5 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 52.4 | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 52.3 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 50.9 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 50.6 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 50.5 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 50.5 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 49.6 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 49.3 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 49.3 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 49.3 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 49 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 48.1 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 48.1 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 47.4 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 45.7 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 44.1 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 43.8 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 41.6 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 41.4 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 41.3 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 34.4 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 32.9 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 32.3 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 31.3 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 30.4 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 30.2 |