Multi-turn Visual Question Answering on MT-GQA (Accuracy Metrics)
65.45Acc1Base
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaseModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 65.45 | 67.32 | 69.12 | 67.3 | |
| MetaCompressModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 64.86 | 65.89 | 67.59 | 66.11 | |
| SampleModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 63.95 | 64.54 | 67.2 | 65.23 | |
| BaseModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 63.83 | 66.68 | 67.94 | 66.15 | |
| MetaCompressModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 63.38 | 64.69 | 67.59 | 65.22 | |
| RandomModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 62.89 | 64.64 | 67.22 | 64.92 | |
| BaseModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 62.47 | 65.21 | 67.22 | 64.97 | |
| SampleModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 62.28 | 64.61 | 66.17 | 64.35 | |
| FastVModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 62.1 | 64.37 | 65.06 | 63.84 | |
| RandomModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 61.96 | 63.95 | 66.29 | 64.07 | |
| BaseModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 61.76 | 64.07 | 65.35 | 63.73 | |
| BaseModel=LLaVA-1.5-7b, Token Merging Method=None (Full Tokens), Reduction Rate=0%2026.03 | 61.76 | 64.07 | 65.35 | 63.73 | |
| FastVModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 61.54 | 64.37 | 65.97 | 63.96 | |
| BaseModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 60.21 | 63.38 | 65.01 | 62.87 | |
| MetaCompressModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 60.11 | 62.28 | 64.14 | 62.18 | |
| MetaCompressModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 59.48 | 61.91 | 65.25 | 62.21 | |
| FastVModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 58.95 | 61.34 | 62.67 | 60.99 | |
| MetaCompressModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 58.62 | 60.96 | 63.64 | 61.07 | |
| SampleModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 58.51 | 61.29 | 62.82 | 60.87 | |
| SampleModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 58.48 | 61.12 | 62.3 | 60.63 | |
| FastVModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 57.99 | 60.75 | 63.51 | 60.75 | |
| PruMergeModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 57.89 | 59.54 | 61.81 | 59.75 | |
| RandomModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 57.79 | 61.07 | 63.09 | 60.65 | |
| SampleModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 57.79 | 61.17 | 63.36 | 60.77 | |
| RandomModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 57.74 | 61.24 | 63.33 | 60.77 | |
| PruMergeModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 57.67 | 60.45 | 62.18 | 60.1 | |
| RandomModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 56.96 | 61.59 | 63.63 | 60.73 | |
| MetaCompressModel=LLaVA-1.5-7b, Token Merging Method=Ours, Reduction Rate=70%2026.03 | 55.95 | 58.71 | 60.64 | 58.43 | |
| VisionZipModel=LLaVA-1.5-7b, Token Merging Method=VisionZip, Reduction Rate=70%2026.03 | 55.08 | 57.82 | 59.89 | 57.6 | |
| FastVModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 54.79 | 57.65 | 60.03 | 57.49 | |
| SampleModel=LLaVA-1.5-7b, Token Merging Method=Sample, Reduction Rate=70%2026.03 | 54.6 | 57.07 | 59.31 | 56.99 | |
| ToMeModel=LLaVA-1.5-7b, Token Merging Method=ToMe, Reduction Rate=70%2026.03 | 53.64 | 56.91 | 57.62 | 56.06 | |
| SpatialModel=LLaVA-1.5-7b, Token Merging Method=Spatial, Reduction Rate=70%2026.03 | 51.05 | 54.62 | 56.24 | 53.97 |