Vision-Language Multi-task Evaluation on MS COCO Unified Multi-task (test)
36.5VQA ScoreHONES
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HONESBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 36.5 | 21 | 24.8 | 5.35 | 21.91 | |
| HONESBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 27.3 | 19 | 19.8 | 7.43 | 18.38 | |
| QRNCABase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 24.5 | — | — | — | — | |
| MABase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 22.05 | 15.5 | 9.86 | 0.65 | 12.02 | |
| QRNCABase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 20.8 | — | — | — | — | |
| Group PatchingBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 20.05 | — | — | — | — | |
| LLM-KnowledgeBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 19.4 | — | — | — | — | |
| Group PatchingBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 18 | — | — | — | — | |
| LLM-KnowledgeBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 16.5 | — | — | — | — | |
| HONES-RandHeadBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 13 | 11.5 | 18 | 3.75 | 11.56 | |
| APBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 11.33 | 10.4 | 8.65 | 0.5 | 7.72 | |
| HONES-NoHeadBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 11 | 8.75 | 10.5 | 2.6 | 8.21 | |
| HONES-NoHeadBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 10.2 | 4.5 | 6.2 | 0.4 | 5.33 | |
| DLABase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 9.8 | — | — | — | — | |
| HONES-RandHeadBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 9.7 | 6.3 | 10 | 1.5 | 6.88 | |
| DLABase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 7.4 | — | — | — | — | |
| MABase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 6.82 | 15.5 | 11.9 | 1.35 | 8.89 | |
| HONES-GaussianBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 5.5 | 9 | 12.5 | 0.8 | 6.95 | |
| APBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 5 | 10.4 | 14.51 | 0.19 | 7.53 | |
| HONES-GaussianBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 4.5 | 3.6 | 9.45 | 0.95 | 4.63 | |
| APEBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 3.2 | -1.87 | 12.2 | 0.9 | 3.61 | |
| RandNeuronBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | 2.45 | 1.98 | 3.3 | 0.15 | 1.97 | |
| RandNeuronBase Model=LLaVA-1.5-7B, Neuron Masking Ratio=1%2026.04 | 0.85 | 1.62 | 2.3 | 0.06 | 1.21 | |
| APEBase Model=Qwen2.5-VL-7B, Neuron Masking Ratio=1%2026.04 | -2.36 | -1.87 | 6.2 | 0.08 | 0.51 |