Open-ended generation on LLaVA-Bench In-the-Wild
109.3ScoreBaseline
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaselineBase Model=QWEN2.5-VL-7B-INSTRUCT2026.05 | 109.3 | — | — | — | |
| FastV + RotateKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 106.9 | — | — | — | |
| VisionZip + RotateKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 106.2 | — | — | — | |
| VisionZipBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.222026.05 | 104 | — | — | — | |
| FastVBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.18752026.05 | 100 | — | — | — | |
| FastV + ThinKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 99.8 | — | — | — | |
| VisionZip + ThinKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 99.1 | — | — | — | |
| FastV + RotateKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 85.5 | — | — | — | |
| VisionZip + RotateKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 84.7 | — | — | — | |
| FastVBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.18752026.05 | 84.6 | — | — | — | |
| BaselineBase Model=LLAMA3-LLAVA-NEXT-8B2026.05 | 84.1 | — | — | — | |
| VisionZipBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.222026.05 | 81.1 | — | — | — | |
| FastV + ThinKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 80.4 | — | — | — | |
| VisionZip + ThinKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 75.3 | — | — | — | |
| BEAM2025.03 | — | 58.94 | 74.71 | 78.25 | |
| Greedy2025.03 | — | 56.94 | 71.83 | 79.95 | |
| IBD2025.03 | — | 61.59 | 77.91 | 82.86 | |
| ICD2025.03 | — | 54.43 | 66.89 | 74.81 | |
| M3ID2025.03 | — | 61.88 | 77.49 | 82.83 | |
| OPERA2025.03 | — | 58.44 | 71.81 | 77.92 | |
| PAI2025.03 | — | 52.29 | 69.74 | 72.49 | |
| PM2025.03 | — | 62.46 | 77.21 | 84.5 | |
| SID2025.03 | — | 59.49 | 70.93 | 81.63 | |
| VCD2025.03 | — | 57.17 | 69.4 | 81.22 | |
| VDD2025.03 | — | 61.6 | 78.22 | 83.01 |