Multimodal Understanding on MM-Vet (5% Forget Set)
43.9Average ScoreVanilla
Evaluation results
| Method | Links | |
|---|---|---|
| VanillaBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 43.9 | |
| MANUBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 40.83 | |
| NPOBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 40.22 | |
| KL Minim.Base Model=Idefics2, Forget Set Ratio=5%2025.02 | 38.61 | |
| Grad. DiffBase Model=Idefics2, Forget Set Ratio=5%2025.02 | 36.67 | |
| GABase Model=Idefics2, Forget Set Ratio=5%2025.02 | 35.12 | |
| VanillaBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 34.08 | |
| MANUBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 32.76 | |
| NPOBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 32.38 | |
| KL Minim.Base Model=LLaVA, Forget Set Ratio=5%2025.02 | 31.29 | |
| Grad. DiffBase Model=LLaVA, Forget Set Ratio=5%2025.02 | 30.28 | |
| GABase Model=LLaVA, Forget Set Ratio=5%2025.02 | 28.92 |