MMBench General Knowledge Retention
81.18COM ScoreVanilla
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VanillaBackbone=Qwen2.5-VL (7B)2025.10 | 81.18 | 70.32 | 65.35 | 78.46 | 61.25 | 47.69 | 66.96 | 12.34 | 66.89 | 39.61 | — | |
| ReplayBackbone=Qwen2.5-VL (7B)2025.10 | 78.54 | 69.17 | 65.26 | 70.2 | 50.72 | 42.74 | 67.48 | 15.12 | 63.94 | 39.53 | 30.89 | |
| VanillaBackbone=LLaVA-v1.5 (13B)2025.10 | 66.86 | 51.12 | 52.7 | 66.04 | 33.93 | 19.64 | 56.77 | 7.7 | 49.51 | 28.6 | — | |
| ReplayBackbone=LLaVA-v1.5 (13B)2025.10 | 61.65 | 47.51 | 48.42 | 61.04 | 24.62 | 19.55 | 54.16 | 16.13 | 45.69 | 30.91 | 66.73 | |
| KOREBackbone=LLaVA-v1.5 (13B)2025.10 | 59.35 | 45.96 | 51.39 | 65.1 | 26.84 | 20.31 | 40.52 | 38.68 | 45.35 | 42.01 | 85.46 | |
| KOREBackbone=Qwen2.5-VL (7B)2025.10 | 56.6 | 67.74 | 65.48 | 70.51 | 45.02 | 43.72 | 58.57 | 27.14 | 58.31 | 42.72 | 67.1 | |
| LoRABackbone=Qwen2.5-VL (7B)2025.10 | 52.54 | 64.54 | 22.35 | 21.39 | 23.25 | 13.52 | 41.38 | 14.29 | 38.16 | 26.22 | 22.03 | |
| LoRABackbone=LLaVA-v1.5 (13B)2025.10 | 45.28 | 32.58 | 43.72 | 23.26 | 17.43 | 15.82 | 38.08 | 19.55 | 32.64 | 26.09 | 63.15 |