Multi-turn Visual Question Answering on MT-GQA balanced (test-dev)
65.45Acc1Base
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaseModel=LLaVA-NeXT-13b, Reduction Rate=0%2026.03 | 65.45 | 67.32 | 69.12 | 67.3 | |
| BaseModel=LLaVA-NeXT-7b, Reduction Rate=0%2026.03 | 63.83 | 66.68 | 67.94 | 66.15 | |
| BaseModel=LLaVA-1.5-13b, Reduction Rate=0%2026.03 | 62.47 | 65.21 | 67.22 | 64.97 | |
| BaseModel=LLaVA-1.5-7b, Reduction Rate=0%2026.03 | 61.76 | 64.07 | 65.35 | 63.73 | |
| MetaCompressModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 60.78 | 63.41 | 65.16 | 63.12 | |
| BaseModel=XComposer-2.5-7b, Reduction Rate=0%2026.03 | 60.21 | 63.38 | 65.01 | 62.87 | |
| SampleModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 59.69 | 62.28 | 63.88 | 61.95 | |
| RandomModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 59.61 | 61.86 | 63.43 | 61.63 | |
| MetaCompressModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 59.43 | 63.49 | 65.19 | 62.7 | |
| RandomModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 58.6 | 61.04 | 63 | 60.88 | |
| SampleModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 58.46 | 61.39 | 63.24 | 61.03 | |
| MetaCompressModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 57.02 | 59.26 | 62.16 | 59.48 | |
| MetaCompressModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 55.99 | 58.49 | 61.55 | 58.68 | |
| MetaCompressModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 55.95 | 58.71 | 60.64 | 58.43 | |
| PruMergeModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 55.7 | 57.94 | 60.7 | 58.11 | |
| SampleModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 55.41 | 58.53 | 60.26 | 58.07 | |
| PruMergeModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 55.26 | 57.23 | 60.13 | 57.54 | |
| SampleModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 55.06 | 57.89 | 59.74 | 57.56 | |
| FastVModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 54.84 | 57.33 | 58.83 | 57 | |
| RandomModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 54.63 | 57.87 | 60.23 | 57.58 | |
| RandomModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 54.6 | 57.07 | 59.31 | 56.99 | |
| SampleModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 52.94 | 57.2 | 59.69 | 56.61 | |
| RandomModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 52.52 | 57.01 | 60.67 | 56.73 | |
| FastVModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 49.08 | 53.34 | 56.14 | 52.85 | |
| FastVModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 47.23 | 51.34 | 53.36 | 50.64 | |
| FastVModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 46.42 | 50.55 | 53.95 | 50.31 | |
| FastVModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 40.98 | 46.71 | 49.3 | 45.66 |