Visual Reasoning on Commonsense Reasoning
8Jaccard Index (J)Dense M.
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Dense M.Backbone=Qwen 7B, Pruning Ratio=0%2026.05 | 8 | 50.9 | 86.07 | 1.58 | |
| Dense M.Backbone=Llama 11B, Pruning Ratio=0%2026.05 | 7.8 | 51.7 | 85.6 | 1.72 | |
| µCRASPBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 7.56 | 35.72 | 81.93 | 2 | |
| Dense M.Backbone=Qwen 3B, Pruning Ratio=0%2026.05 | 7.5 | 49.08 | 84.95 | 1.74 | |
| Dense M.Backbone=Gemma 4B, Pruning Ratio=0%2026.05 | 7.02 | 46.55 | 84.31 | 1.71 | |
| Dense M.Backbone=Qwen 2B, Pruning Ratio=0%2026.05 | 6.97 | 39.65 | 81.98 | 2.21 | |
| Attribution P.Backbone=Llama 11B, Pruning Ratio=30%2026.05 | 6.95 | 23.93 | 79.99 | 2.81 | |
| µCRASPBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 6.7 | 23.1 | 77.54 | 3.4 | |
| µCRASPBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 6.66 | 34.9 | 80.41 | 2.39 | |
| Attribution P.Backbone=Qwen 7B, Pruning Ratio=30%2026.05 | 6.56 | 1.31 | 62.91 | 5.3 | |
| LLM-PrunerBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 6.45 | 7.4 | 75.19 | 3.4 | |
| µCRASPBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 6.26 | 31.7 | 80.03 | 2.4 | |
| Attribution P.Backbone=Gemma 4B, Pruning Ratio=30%2026.05 | 6.19 | 28.4 | 78.57 | 2.4 | |
| Wanda-SPBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 5.83 | 7.9 | 71.78 | 3.5 | |
| µCRASPBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 5.3 | 13.9 | 76.02 | 3.8 | |
| Attribution P.Backbone=Qwen 2B, Pruning Ratio=30%2026.05 | 5.21 | 5.9 | 72.57 | 3.5 | |
| LLM-PrunerBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 5.11 | 0 | 62.78 | 3.5 | |
| LLM-PrunerBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 4.91 | 0.4 | 69.1 | 4.2 | |
| Wanda-SPBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 4.43 | 0 | 57.95 | 4.63 | |
| Wanda-SPBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 3.63 | 0.2 | 50.36 | 18.9 | |
| LLM-PrunerBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 2.77 | 0 | 55.41 | 4.96 | |
| FLAPBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 2.02 | 0 | 44.9 | 12.2 | |
| Wanda-SPBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 1.29 | 0.7 | 54.83 | 4.9 | |
| FLAPBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 1.13 | 0 | 34.8 | 20.7 | |
| LLM-PrunerBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 0.67 | 0 | 38.67 | 10.4 | |
| Wanda-SPBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 0.6 | 0 | 10.36 | 17.4 | |
| FLAPBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 0.2 | 0 | 12.78 | 95.1 | |
| FLAPBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 0.09 | 0 | 8.89 | 44.2 | |
| FLAPBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 0.05 | 0 | 27.76 | 99.2 | |
| Attribution P.Backbone=Qwen 3B, Pruning Ratio=30%2026.05 | 0.02 | 0 | 8.8 | — |