Multi-turn Visual Question Answering on ConvBench
20S1 ScoreFastV
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FastVModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 20 | 5 | 3.33 | 9.44 | |
| SampleModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 15.94 | 11.79 | 6.07 | 11.27 | |
| MetaCompressModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 15.77 | 12.13 | 6.24 | 11.38 | |
| RandomModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 15.42 | 10.23 | 7.97 | 11.21 | |
| FastVModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 12.5 | 4.17 | 12.5 | 9.72 | |
| BaseModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 12.48 | 13.17 | 7.97 | 11.21 | |
| BaseModel=XComposer-2.5-7b, Reduction Rate=70%2026.03 | 12.48 | 7 | 7.97 | 9.15 | |
| BaseModel=LLaVA-NeXT-13b, Reduction Rate=0%2026.03 | 12.48 | 13.17 | 7.97 | 11.21 | |
| BaseModel=XComposer-2.5-7b, Reduction Rate=0%2026.03 | 12.48 | 7 | 7.97 | 9.15 | |
| MetaCompressModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 12.31 | 9.71 | 7.63 | 9.88 | |
| SampleModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 12.13 | 9.53 | 7.63 | 9.76 | |
| RandomModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 11.44 | 11.27 | 8.15 | 10.29 | |
| RandomModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 11.35 | 9.88 | 7.28 | 9.5 | |
| MetaCompressModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 10.92 | 13.86 | 7.11 | 10.63 | |
| SampleModel=LLaVA-NeXT-13b, Reduction Rate=70%2026.03 | 10.4 | 14.04 | 6.76 | 10.4 | |
| RandomModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 7.97 | 9.19 | 6.93 | 8.03 | |
| BaseModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 7.95 | 11.46 | 7.58 | 9 | |
| BaseModel=LLaVA-NeXT-7b, Reduction Rate=0%2026.03 | 7.95 | 11.46 | 7.58 | 9 | |
| SampleModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 7.63 | 8.32 | 4.33 | 6.76 | |
| MetaCompressModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 7.63 | 9.88 | 7.45 | 8.32 | |
| RandomModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 7.2 | 9.19 | 6.33 | 7.57 | |
| MetaCompressModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 6.93 | 11.27 | 6.76 | 8.32 | |
| SampleModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 6.07 | 10.92 | 6.07 | 7.69 | |
| RandomModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 5.81 | 6.59 | 4.42 | 5.61 | |
| FastVModel=LLaVA-NeXT-13b, Reduction Rate=90%2026.03 | 5.17 | 5.17 | 1.72 | 4.02 | |
| MetaCompressModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 4.68 | 4.51 | 6.41 | 5.2 | |
| PruMergeModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 4.51 | 6.41 | 5.37 | 5.43 | |
| PruMergeModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 4.51 | 3.47 | 3.47 | 3.82 | |
| PruMergeModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 4.51 | 3.99 | 5.55 | 4.68 | |
| FastVModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 4.37 | 6.92 | 5.1 | 5.46 | |
| BaseModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 4.33 | 5.72 | 5.55 | 5.2 | |
| BaseModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 4.33 | 7.11 | 5.72 | 5.72 | |
| MetaCompressModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 4.33 | 6.93 | 5.37 | 5.55 | |
| BaseModel=LLaVA-1.5-7b, Reduction Rate=0%2026.03 | 4.33 | 5.72 | 5.55 | 5.2 | |
| MetaCompressModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 4.33 | 3.99 | 4.16 | 4.16 | |
| BaseModel=LLaVA-1.5-13b, Reduction Rate=0%2026.03 | 4.33 | 7.11 | 5.72 | 5.72 | |
| RandomModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 4.17 | 4.73 | 5.51 | 4.8 | |
| FastVModel=XComposer-2.5-7b, Reduction Rate=90%2026.03 | 4.17 | 4.17 | 0 | 2.78 | |
| SampleModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 4.16 | 5.03 | 3.81 | 4.33 | |
| SampleModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 4.16 | 5.03 | 4.33 | 4.51 | |
| MetaCompressModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 4.16 | 8.67 | 9.01 | 7.28 | |
| RandomModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 4.03 | 4.89 | 5.24 | 4.72 | |
| FastVModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 3.99 | 5.03 | 3.47 | 4.16 | |
| MetaCompressModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 3.99 | 5.03 | 4.85 | 4.62 | |
| SampleModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 3.81 | 7.28 | 5.72 | 5.6 | |
| RandomModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 3.73 | 3.99 | 4.08 | 3.93 | |
| PruMergeModel=LLaVA-1.5-7b, Reduction Rate=70%2026.03 | 3.64 | 4.68 | 4.68 | 4.33 | |
| SampleModel=LLaVA-1.5-13b, Reduction Rate=70%2026.03 | 3.64 | 5.03 | 5.37 | 4.68 | |
| SampleModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 3.64 | 4.85 | 3.81 | 4.1 | |
| RandomModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 3.56 | 5.55 | 4.42 | 4.51 | |
| FastVModel=LLaVA-1.5-13b, Reduction Rate=90%2026.03 | 2.19 | 3.47 | 4.2 | 3.29 | |
| FastVModel=LLaVA-1.5-7b, Reduction Rate=90%2026.03 | 1.56 | 1.39 | 3.12 | 2.02 | |
| FastVModel=LLaVA-NeXT-7b, Reduction Rate=70%2026.03 | 0 | 0 | 2.5 | 0.83 | |
| FastVModel=LLaVA-NeXT-7b, Reduction Rate=90%2026.03 | 0 | 1.85 | 1.85 | 1.23 |