Multi-turn Visual Question Answering on MT-VQA v2 (val)
81.02Acc1Base
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaseModel=LLaVA-NeXT-13b, Reduction Rate=0%2026.03 | 81.02 | 82.32 | 81.64 | 81.66 | |
| BaseModel=LLaVA-NeXT-7b, Reduction Rate=0%2026.03 | 80.2 | 80.86 | 80.71 | 80.59 | |
| BaseModel=XComposer-2.5-7b, Reduction Rate=0%2026.03 | 78.8 | 81.12 | 81.24 | 80.39 | |
| BaseModel=LLaVA-1.5-13b, Reduction Rate=0%2026.03 | 78.35 | 79.47 | 78.92 | 78.91 | |
| BaseModel=LLaVA-1.5-7b, Reduction Rate=0%2026.03 | 76.72 | 77.51 | 77.3 | 77.18 | |
| MetaCompressModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 74.62 | 75.73 | 75.42 | 75.26 | |
| MetaCompressModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 73.91 | 76.68 | 76.7 | 75.76 | |
| MetaCompressModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 73.83 | 75.24 | 75.18 | 75.18 | |
| MetaCompressModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 72.7 | 73.24 | 72.88 | 72.94 | |
| FastVModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 72.65 | 75.02 | 75.02 | 74.23 | |
| SampleModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 71.97 | 73.84 | 73.43 | 73.08 | |
| RandomModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 71.86 | 73.44 | 73.22 | 72.84 | |
| SampleModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 70.88 | 72.32 | 72.35 | 71.85 | |
| RandomModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 70.65 | 72.26 | 72.44 | 71.78 | |
| MetaCompressModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 70.27 | 70.31 | 71.36 | 70.65 | |
| PruMergeModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 70.18 | 71.16 | 70.7 | 70.68 | |
| PruMergeModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 69.03 | 69.93 | 69.73 | 69.56 | |
| SampleModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 68.46 | 70.92 | 70.78 | 70.05 | |
| SampleModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 68.12 | 68.82 | 68.47 | 68.47 | |
| RandomModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 67.88 | 70.2 | 70.49 | 69.52 | |
| RandomModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 67.26 | 68.05 | 67.63 | 67.65 | |
| SampleModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 67.11 | 67.52 | 67.63 | 67.42 | |
| RandomModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 66.36 | 66.94 | 66.68 | 66.66 | |
| FastVModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 57.09 | 59 | 59.27 | 58.45 | |
| FastVModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 57.07 | 59.09 | 59.14 | 58.43 | |
| FastVModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 55.36 | 56.8 | 57.08 | 56.41 | |
| FastVModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 45.98 | 48.56 | 49.65 | 48.06 |