Visual Reasoning on MMStar 1.0 (test)
63.63Coarse ScoreLLaVA-1.5-7B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LLaVA-1.5-7BNumber of Tokens=5762025.08 | 63.63 | 25.63 | 38.89 | 28.92 | 26.6 | 18.48 | 33.69 | |
| MMTokNumber of Tokens=322025.08 | 59.56 | 25.71 | 40.49 | 29.94 | 27.92 | 17.37 | 33.5 | |
| MMTokNumber of Tokens=642025.08 | 59.08 | 22.66 | 39.51 | 29.66 | 28.39 | 20.66 | 33.33 | |
| DivPruneNumber of Tokens=642025.08 | 56.35 | 19.5 | 36.72 | 27.73 | 26.7 | 18.94 | 30.99 | |
| MMTokNumber of Tokens=162025.08 | 56.32 | 21.58 | 39.48 | 30.22 | 23.98 | 15.16 | 31.12 | |
| VisionZipNumber of Tokens=642025.08 | 55.27 | 22.92 | 39.32 | 27.95 | 24.76 | 24.62 | 32.47 | |
| DivPruneNumber of Tokens=322025.08 | 54.82 | 21.07 | 37.03 | 27.82 | 24.18 | 19.32 | 30.71 | |
| MMTokNumber of Tokens=82025.08 | 54.11 | 21.26 | 35.09 | 29.56 | 20.34 | 15.04 | 29.23 | |
| DivPruneNumber of Tokens=162025.08 | 49.99 | 21.45 | 38.37 | 28.45 | 21.54 | 18.58 | 29.73 | |
| VisionZipNumber of Tokens=322025.08 | 48.58 | 19.04 | 39.73 | 29.69 | 22.91 | 21.95 | 30.32 | |
| DivPruneNumber of Tokens=82025.08 | 47.25 | 21.05 | 33.89 | 25.75 | 20.32 | 16.76 | 27.5 | |
| VisionZipNumber of Tokens=162025.08 | 43.76 | 21.34 | 32.58 | 25.97 | 23.18 | 19.96 | 27.8 | |
| BaselineNumber of Tokens=02025.08 | 31.85 | 19.1 | 23.77 | 23.61 | 14.28 | 16.11 | 21.45 | |
| VisionZipNumber of Tokens=82025.08 | 27.93 | 21.26 | 25.71 | 21.84 | 20.18 | 17.83 | 22.46 |