Open-ended generation on MM-Vet
45.55MM-Vet ScoreBaseline
Evaluation Results
| Method | Links | |
|---|---|---|
| BaselineBase Model=QWEN2.5-VL-7B-INSTRUCT2026.05 | 45.55 | |
| VisionZip + RotateKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 44.04 | |
| FastV + RotateKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 41.24 | |
| VisionZip + ThinKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 35 | |
| VisionZipBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.222026.05 | 34.77 | |
| FastVBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.18752026.05 | 32.61 | |
| FastV + ThinKBase Model=QWEN2.5-VL-7B-INSTRUCT, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 32.61 | |
| BaselineBase Model=LLAMA3-LLAVA-NEXT-8B2026.05 | 27.14 | |
| FastV + RotateKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 26.97 | |
| VisionZip + RotateKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 26.97 | |
| FastV + ThinKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.30, Channel Sparsity Ratio=0.252026.05 | 25.05 | |
| VisionZipBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.222026.05 | 24.59 | |
| FastVBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.18752026.05 | 24.5 | |
| VisionZip + ThinKBase Model=LLAMA3-LLAVA-NEXT-8B, Token Sparsity Ratio=0.35, Channel Sparsity Ratio=0.252026.05 | 23.72 |