Real-world Visual Understanding on RealWorldQA (Score Metric)
72.29ScoreOurs-Mixed
Evaluation Results
| Method | Links | |
|---|---|---|
| Ours-MixedPruning Budget=10%2026.03 | 72.29 | |
| Ours-MathPruning Budget=10%2026.03 | 71.63 | |
| CKAPruning Budget=10%2026.03 | 71.11 | |
| Ours-MathPruning Budget=25%2026.03 | 70.46 | |
| Ours-NonMathPruning Budget=10%2026.03 | 69.54 | |
| Ours-NonMathPruning Budget=25%2026.03 | 68.76 | |
| DARTToken Retention Ratio=70%2026.05 | 68.6 | |
| Ours-MixedPruning Budget=25%2026.03 | 68.5 | |
| VanillaToken Retention Ratio=100%2026.05 | 68.5 | |
| SPprunerToken Retention Ratio=70%2026.05 | 68.4 | |
| SPprunerToken Retention Ratio=50%2026.05 | 68 | |
| RandomPruning Budget=10%2026.03 | 67.97 | |
| FastVToken Retention Ratio=50%2026.05 | 67.4 | |
| DARTToken Retention Ratio=50%2026.05 | 67.3 | |
| SPprunerToken Retention Ratio=30%2026.05 | 66.8 | |
| FastVToken Retention Ratio=70%2026.05 | 66.5 | |
| InterlacePruning Budget=10%2026.03 | 64.97 | |
| FastVToken Retention Ratio=30%2026.05 | 64.7 | |
| DARTToken Retention Ratio=30%2026.05 | 63.9 | |
| Ours-MathPruning Budget=40%2026.03 | 63.01 | |
| InterlacePruning Budget=25%2026.03 | 62.88 | |
| InterlacePruning Budget=40%2026.03 | 62.88 | |
| Ours-NonMathPruning Budget=40%2026.03 | 61.7 | |
| Ours-MixedPruning Budget=40%2026.03 | 60.92 | |
| MRoPE-IBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=MRoPE-I2025.10 | 59.78 | |
| MHRoPEBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=MHRoPE2025.10 | 58.86 | |
| RandomPruning Budget=25%2026.03 | 58.43 | |
| CKAPruning Budget=25%2026.03 | 57.91 | |
| HoPEBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=HoPE2025.10 | 57.52 | |
| VideoRoPEBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=VideoRoPE2025.10 | 57.25 | |
| CircleRoPEBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=CircleRoPE2025.10 | 57.25 | |
| Vanilla RoPEBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=Vanilla RoPE2025.10 | 57.12 | |
| RandomPruning Budget=40%2026.03 | 56.73 | |
| MRoPEBackbone Model=Qwen3-VL-4B-Instruct, Positional Encoding Variant=MRoPE2025.10 | 56.6 | |
| CKAPruning Budget=40%2026.03 | 46.27 | |
| Pre-trainedTrainable Params=02026.03 | 0.664 | |
| IADA +LoRATrainable Params=7.7M2026.03 | 0.639 | |
| LoRA-onlyTrainable Params=7.6M2026.03 | 0.634 | |
| AttnRes+LoRATrainable Params=7.7M2026.03 | 0.626 |