Cloze Task on MLLMU-Bench (test)
13.04AccuracyGA_Diff
Evaluation Results
| Method | Links | |
|---|---|---|
| GA_DiffBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 13.04 | |
| KL_MinBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 13.04 | |
| POBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 13.04 | |
| Noise-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 13.04 | |
| VGIDBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 13.04 | |
| ICU-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 13.04 | |
| GABackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 13.03 | |
| BaseBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 10.87 | |
| NPOBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 10.87 | |
| RMUBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 10.87 | |
| ICU-TBackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 10.87 | |
| NPOBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.87 | |
| BaseBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.86 | |
| POBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 10.86 | |
| GABackbone=LLaVA-1.5-7B, Forget Ratio=5%2026.05 | 8.69 | |
| Noise-TBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 8.69 | |
| VGIDBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 8.69 | |
| KL_MinBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 8.34 | |
| GA_DiffBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 4.17 | |
| POBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 4.17 | |
| GA_DiffBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 2.18 | |
| RMUBackbone=LLaVA-1.5-13B, Forget Ratio=5%2026.05 | 2.17 | |
| BaseBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| GABackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| KL_MinBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| NPOBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| RMUBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| ICU-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| Noise-TBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 | |
| VGIDBackbone=Qwen2.5-VL-3B, Forget Ratio=5%2026.05 | 2.08 |