Medical Visual Question Answering on PMC-Reasoning
56.47MMMUHyperINF
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| HyperINFBackbone=Qwen2.5-VL-3B, Selection Ratio=20%, Time=1.7 (h)2025.08 | 56.47 | 20.5 | 62.14 | 51.45 | 62.98 | 64.71 | 53.04 | |
| For-ValueBackbone=Qwen2.5-VL-3B, Selection Ratio=20%, Time=0.4 (h)2025.08 | 54.12 | 22.45 | 60.26 | 50.45 | 65.14 | 63.6 | 52.67 | |
| Hessian-freeBackbone=Qwen2.5-VL-3B, Selection Ratio=20%, Time=1.3 (h)2025.08 | 52.94 | 21.4 | 61.81 | 52.05 | 63.46 | 62.5 | 52.36 | |
| HyperINFBackbone=Qwen2.5-VL-3B, Selection Ratio=10%, Time=1.7 (h)2025.08 | 50 | 21.6 | 61.1 | 50.45 | 62.5 | 63.97 | 51.6 | |
| DataInfBackbone=Qwen2.5-VL-3B, Selection Ratio=10%, Time=1.6 (h)2025.08 | 49.41 | 21.1 | 62.64 | 50.55 | 59.38 | 65.81 | 51.48 | |
| Hessian-freeBackbone=Qwen2.5-VL-3B, Selection Ratio=10%, Time=1.3 (h)2025.08 | 48.82 | 20.65 | 61.18 | 49.6 | 61.78 | 63.6 | 50.94 | |
| DataInfBackbone=Qwen2.5-VL-3B, Selection Ratio=20%, Time=1.6 (h)2025.08 | 48.82 | 21.25 | 62.58 | 51.35 | 63.46 | 63.24 | 51.78 | |
| FullBackbone=Qwen2.5-VL-3B, Selection Ratio=Full2025.08 | 47.84 | 21.46 | 52.76 | 54.55 | 65.79 | 58.58 | 50.16 | |
| For-ValueBackbone=Qwen2.5-VL-3B, Selection Ratio=10%, Time=0.4 (h)2025.08 | 47.06 | 23.05 | 62.93 | 49.55 | 67.55 | 63.24 | 52.23 | |
| BaseBackbone=Qwen2.5-VL-3B, Selection Ratio=Base2025.08 | 44.12 | 20.69 | 61.96 | 44.77 | 61.3 | 62.01 | 49.14 |