Cloze on MLLMU-Bench (Forget Set)
26.09Cloze AccuracyICU-T
Evaluation Results
| Method | Links | |
|---|---|---|
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 26.09 | |
| VanillaBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 25.81 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 23.91 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 23.91 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 23.91 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 21.74 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 21.74 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 21.73 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 19.56 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 19.56 | |
| MANUBase Model=LLaVA-1.5-7B, Forget Percentage=5%2025.02 | 17.08 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 12.5 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 12.5 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.87 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.87 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.87 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 10.86 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.86 | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 10.42 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 8.7 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 8.69 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 8.69 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 8.33 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 6.52 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 6.52 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 4.35 |