Multimodal Continual Learning on MRCL 1.0 (test)
100MedBook ScoreKeepLoRA
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| KeepLoRABackbone=Qwen3-VL-8B2026.07 | 100 | 63.05 | 49 | 94.25 | 40.95 | 73.9 | 69.45 | 70.52 | |
| SEFEBackbone=Qwen3-VL-8B2026.07 | 99.49 | 53.12 | 45.17 | 92.25 | 44.05 | 70.79 | 66.82 | 68.26 | |
| O-LoRABackbone=Qwen3-VL-8B2026.07 | 98.64 | 35.11 | 44.36 | 86.5 | 42.65 | 67.15 | 61.45 | 64.11 | |
| CPOBackbone=Qwen3-VL-8B2026.07 | 96.94 | 90.99 | 64.87 | 74 | 50.5 | 74.8 | 75.46 | 74.69 | |
| KeepLoRABackbone=Qwen3-VL-4B2026.07 | 95.42 | 65.26 | 46.51 | 93.75 | 37.9 | 69.9 | 67.77 | 68.57 | |
| SEFEBackbone=Qwen3-VL-4B2026.07 | 94.74 | 55.15 | 43.48 | 91 | 40.3 | 68.5 | 64.93 | 66.7 | |
| LoRABackbone=Qwen3-VL-8B, Strategy=Parameter-Efficient Fine-tuning2026.07 | 94.57 | 42.46 | 45.11 | 91.5 | 41.2 | 70.36 | 62.97 | 66.47 | |
| CPOBackbone=Qwen3-VL-4B2026.07 | 90.83 | 76.84 | 63.64 | 77.5 | 49 | 73.24 | 71.56 | 72.81 | |
| O-LoRABackbone=Qwen3-VL-4B2026.07 | 89.3 | 37.68 | 41.98 | 93.25 | 39.85 | 67.44 | 60.41 | 64.2 | |
| LoRABackbone=Qwen3-VL-4B2026.07 | 85.57 | 25.37 | 43.81 | 85.75 | 40.2 | 68.81 | 56.14 | 63.02 | |
| Full SFTBackbone=Qwen3-VL-8B, Strategy=Full Parameter Fine-tuning2026.07 | 79.8 | 33.46 | 38.94 | 35 | 32.75 | 60.5 | 43.99 | 51.21 | |
| GSPOBackbone=Qwen3-VL-8B2026.07 | 78.61 | 44.67 | 53.45 | 85.25 | 46.95 | 76.48 | 61.79 | 69.24 | |
| GRPOBackbone=Qwen3-VL-8B2026.07 | 73.51 | 6.62 | 55.43 | 72.25 | 45.8 | 64.99 | 50.72 | 57.06 | |
| GRPOBackbone=Qwen3-VL-4B2026.07 | 70.63 | 39.34 | 58.18 | 68.25 | 47.75 | 67.29 | 56.83 | 60.04 | |
| GSPOBackbone=Qwen3-VL-4B2026.07 | 65.03 | 30.7 | 45.17 | 83 | 44.8 | 74.26 | 53.74 | 63.94 | |
| GRPO*Backbone=Qwen3-VL-4B2026.07 | 63.16 | 40.26 | 62.84 | 65.5 | 48.5 | 61.77 | 56.05 | 58.51 | |
| Zero-shot1Backbone=Qwen3-VL-8B, Setting=12026.07 | 62.48 | 0 | 35 | 36.5 | 47.6 | — | — | 36.32 | |
| Zero-shot¹Backbone=Qwen3-VL-4B2026.07 | 56.88 | 3.31 | 34.6 | 36 | 41.6 | — | — | 34.48 | |
| Full SFTBackbone=Qwen3-VL-4B2026.07 | 56.71 | 3.12 | 37.84 | 84.5 | 37.9 | 70.04 | 44.01 | 55.85 | |
| Zero-shot2Backbone=Qwen3-VL-8B, Setting=22026.07 | 51.27 | 25.55 | 34.61 | 25.25 | 39.65 | — | — | 35.27 | |
| Zero-shot²Backbone=Qwen3-VL-4B2026.07 | 49.75 | 20.77 | 38.27 | 24.75 | 38.95 | — | — | 34.5 |