Visual Reasoning on Quantitative Reasoning
8.44J ScoreµCRASP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| µCRASPBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 8.44 | 82.1 | 86.84 | 1.66 | |
| Dense M.Backbone=Qwen 7B, Pruning Ratio=0%2026.05 | 8.33 | 91.6 | 91.85 | 1.31 | |
| Dense M.Backbone=Qwen 3B, Pruning Ratio=0%2026.05 | 8.33 | 91.6 | 91.85 | 1.31 | |
| Dense M.Backbone=Llama 11B, Pruning Ratio=0%2026.05 | 7.91 | 89.3 | 90.88 | 1.44 | |
| Dense M.Backbone=Gemma 4B, Pruning Ratio=0%2026.05 | 7.85 | 90.23 | 91.08 | 1.38 | |
| Dense M.Backbone=Qwen 2B, Pruning Ratio=0%2026.05 | 7.55 | 87.45 | 89.35 | 1.8 | |
| µCRASPBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 7.51 | 41 | 83.79 | 2.35 | |
| µCRASPBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 7.29 | 79.8 | 87.01 | 1.88 | |
| µCRASPBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 6.95 | 87.4 | 87.89 | 2.1 | |
| Attribution P.Backbone=Gemma 4B, Pruning Ratio=30%2026.05 | 6.94 | 83.8 | 85.55 | 2.3 | |
| LLM-PrunerBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 6.74 | 63.8 | 84.51 | 2.03 | |
| µCRASPBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 6.65 | 52 | 83.55 | 2.37 | |
| Attribution P.Backbone=Qwen 2B, Pruning Ratio=30%2026.05 | 6.26 | 13 | 74.84 | 2.71 | |
| Attribution P.Backbone=Llama 11B, Pruning Ratio=30%2026.05 | 5.78 | 9.46 | 76.77 | 2.49 | |
| LLM-PrunerBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 5.64 | 0 | 60.35 | 3.12 | |
| Wanda-SPBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 4.76 | 15.2 | 74.15 | 3.31 | |
| LLM-PrunerBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 4.39 | 0.6 | 68.76 | 3.84 | |
| FLAPBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 3.41 | 0 | 47.66 | 7.18 | |
| Wanda-SPBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 3.02 | 0 | 57.46 | 3.6 | |
| LLM-PrunerBackbone=Llama 11B, Pruning Ratio=30%2026.05 | 2.44 | 0 | 54.46 | 3.89 | |
| Wanda-SPBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 1.61 | 1.3 | 62.56 | 3.51 | |
| Wanda-SPBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 0.9 | 0 | 18.9 | 12.92 | |
| FLAPBackbone=Qwen 2B, Pruning Ratio=30%2026.05 | 0.7 | 0 | 35.08 | 17.7 | |
| Wanda-SPBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 0.5 | 0 | 53.77 | 21.27 | |
| LLM-PrunerBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 0.45 | 0 | 42.74 | 10.5 | |
| Attribution P.Backbone=Qwen 7B, Pruning Ratio=30%2026.05 | 0.08 | 0 | 16.78 | 166.6 | |
| FLAPBackbone=Qwen 3B, Pruning Ratio=30%2026.05 | 0.06 | 0 | 38.09 | 40.43 | |
| FLAPBackbone=Gemma 4B, Pruning Ratio=30%2026.05 | 0.04 | 0 | 25.76 | 49.87 | |
| FLAPBackbone=Qwen 7B, Pruning Ratio=30%2026.05 | 0.02 | 0 | 29.07 | 52.49 | |
| Attribution P.Backbone=Qwen 3B, Pruning Ratio=30%2026.05 | 0.01 | 0 | 5.05 | — |