Multi-turn Visual Question Answering on MT-VQA v2
81.02Acc1Base
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaseModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 81.02 | 82.32 | 81.64 | 81.66 | |
| BaseModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 80.2 | 80.86 | 80.71 | 80.59 | |
| BaseModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 78.8 | 81.12 | 81.24 | 80.39 | |
| BaseModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 78.35 | 79.47 | 78.92 | 78.91 | |
| MetaCompressModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 78.24 | 80.53 | 80.79 | 79.85 | |
| MetaCompressModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 78.14 | 80.98 | 80.21 | 79.78 | |
| FastVModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 77.93 | 80.18 | 80.05 | 79.39 | |
| MetaCompressModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 77.75 | 78.06 | 78.54 | 78.12 | |
| SampleModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 77.51 | 79.15 | 79.03 | 78.56 | |
| RandomModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 77.3 | 78.77 | 78.65 | 78.24 | |
| BaseModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 76.72 | 77.51 | 77.3 | 77.18 | |
| SampleModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 76.6 | 77.93 | 77.96 | 77.5 | |
| RandomModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 76.18 | 77.43 | 77.64 | 77.08 | |
| FastVModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 75.96 | 76.86 | 76.39 | 76.4 | |
| FastVModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 75.78 | 77.16 | 76.66 | 76.53 | |
| MetaCompressModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 75.67 | 76.63 | 76.46 | 76.25 | |
| SampleModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 75.07 | 77.68 | 78.04 | 76.93 | |
| RandomModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 74.63 | 77.23 | 77.44 | 76.43 | |
| MetaCompressModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 74.03 | 76.98 | 76.31 | 75.77 | |
| FastVModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 73.85 | 75.18 | 74.58 | 74.54 | |
| SampleModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 73.81 | 74.79 | 74.51 | 74.37 | |
| PruMergeModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 73.8 | 75.16 | 74.57 | 74.51 | |
| RandomModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 73.63 | 74.56 | 73.96 | 74.05 | |
| SampleModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 72.96 | 73.71 | 73.33 | 73.33 | |
| PruMergeModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 72.79 | 73.9 | 73.42 | 73.37 | |
| RandomModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 72.72 | 73.57 | 73.11 | 73.13 | |
| FastVModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 69.3 | 69.57 | 69.41 | 69.43 |