Cloze Task on MLLMU-Bench (Retain Set)
24.52AccuracyNoise-T
Evaluation Results
| Method | Links | |
|---|---|---|
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 24.52 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 24 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 23.15 | |
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 20 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 19.13 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 19.12 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 19 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 18.81 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 18 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 17.34 | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 16.16 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 16.16 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 16.16 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 16.16 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 15.66 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 15.66 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 15 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 14.65 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 11.63 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 11.62 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 11.21 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.78 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.57 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.15 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 9.19 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 9 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 5.5 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 1.51 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 1.26 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 1.01 |