Visual Question Answering on TextVQA (Accuracy, Retention)
88.7AccuracyKimi-VL-A3B-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Kimi-VL-A3B-Instructk=6, Status=Default2025.11 | 88.7 | — | |
| MoDESSkip x% Experts=50%, rho=0.482025.11 | 88.18 | — | |
| DiEPSkip x% Experts=50%, rho=0.482025.11 | 87.43 | — | |
| MC-MoESkip x% Experts=50%, rho=0.482025.11 | 86.28 | — | |
| NAEESkip x% Experts=50%, rho=0.482025.11 | 86.14 | — | |
| MoDESSkip x% Experts=67%, rho=0.652025.11 | 85.57 | — | |
| Top-k Skippingk=3, Skip x% Experts=50%, rho=0.482025.11 | 85.41 | — | |
| MC-MoESkip x% Experts=67%, rho=0.652025.11 | 85.07 | — | |
| DiEPSkip x% Experts=67%, rho=0.652025.11 | 84.21 | — | |
| Top-k Skippingk=2, Skip x% Experts=67%, rho=0.652025.11 | 83.49 | — | |
| NAEESkip x% Experts=67%, rho=0.652025.11 | 82.84 | — | |
| MoDESSkip x% Experts=83%, rho=0.82025.11 | 82.38 | — | |
| DiEPSkip x% Experts=83%, rho=0.82025.11 | 82.32 | — | |
| Qwen2-VL 7BBackbone=Qwen2-VL 7B, Sparsity Level=0%, Pruning Method=Dense, Pruning Type=None2026.03 | 82.02 | 100 | |
| MC-MoESkip x% Experts=83%, rho=0.82025.11 | 79.41 | — | |
| SparseGPTBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=SparseGPT, Pruning Type=unstructured, uniform pruning2026.03 | 78.51 | 85.3 | |
| BLIP3o-4BType=Und. and Gen. > 2B, # Total Params=7.1B2026.02 | 78 | — | |
| TAMPBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=TAMP, Pruning Type=unstructured, uniform pruning2026.03 | 77.24 | 83.79 | |
| Top-k Skippingk=1, Skip x% Experts=83%, rho=0.82025.11 | 77.17 | — | |
| ATV-PruningBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=ATV-Pruning, Pruning Type=unstructured, uniform pruning2026.03 | 76.96 | 85.65 | |
| WandaBackbone=Qwen2-VL 7B, Sparsity Level=60%, Pruning Method=Wanda, Pruning Type=unstructured, uniform pruning2026.03 | 75.76 | 77.78 | |
| NAEESkip x% Experts=83%, rho=0.82025.11 | 75.73 | — | |
| FastVLM-0.5BType=Und. Only ≤ 1B, # Total Params=0.6B2026.02 | 68 | — | |
| Mobile-O-0.5BType=Und. and Gen. ≤ 2B, # Total Params=1.6B2026.02 | 67.8 | — | |
| VISORFLOPs Savings=8.6×2026.03 | 67.8 | — | |
| VISOR-TRFLOPs Savings=18×2026.03 | 67.4 | — | |
| M³FLOPs Savings=8.0×2026.03 | 67 | — | |
| LLaVA-OVFLOPs Savings=1.0×2026.03 | 66 | — | |
| LLaVA-NeXT 8BBackbone=LLaVA-NeXT 8B, Sparsity Level=0%, Pruning Method=Dense, Pruning Type=None2026.03 | 65.42 | 100 | |
| EMU3-8BType=Und. and Gen. > 2B, # Total Params=9.0B2026.02 | 64.7 | — | |
| SparseGPTBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=SparseGPT, Pruning Type=unstructured, uniform pruning2026.03 | 64.21 | 91.74 | |
| WandaBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=Wanda, Pruning Type=unstructured, uniform pruning2026.03 | 64.04 | 88.36 | |
| TAMPBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=TAMP, Pruning Type=unstructured, uniform pruning2026.03 | 62.78 | 92.67 | |
| ATV-PruningBackbone=LLaVA-NeXT 8B, Sparsity Level=50%, Pruning Method=ATV-Pruning, Pruning Type=unstructured, uniform pruning2026.03 | 62.76 | 94 | |
| SparseVLMFLOPs Savings=4.5×2026.03 | 62.7 | — | |
| VanillaBackbone=LLaVA-NeXT-7B, Token Retention=2880, Reduction Ratio=100%2026.02 | 61.3 | — | |
| SparseGPTBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=SparseGPT, Pruning Type=unstructured, uniform pruning2026.03 | 61.06 | 76.24 | |
| Smol-VLM-0.5BType=Und. Only ≤ 1B, # Total Params=0.6B2026.02 | 60.2 | — | |
| VisionZipBackbone=LLaVA-NeXT-7B, Token Retention=640, Reduction Ratio=77.8%2026.02 | 60.2 | — | |
| LLaVA-NeXT-7B (Upper Bound)Backbone=LLaVA-NeXT-7B, Tokens Kept=2880, Pruning Ratio=0.0%2025.12 | 59.6 | 100 | |
| FlashVLMBackbone=LLaVA-NeXT-7B, Tokens Kept=640, Pruning Ratio=77.8%2025.12 | 59.4 | 99.12 | |
| VisPrunerBackbone=LLaVA-NeXT-7B, Tokens Kept=640, Pruning Ratio=77.8%2025.12 | 59.3 | 98.6 | |
| VisionZipBackbone=LLaVA-NeXT-7B, Token Retention=320, Reduction Ratio=88.9%2026.02 | 58.9 | — | |
| SparseVLMBackbone=LLaVA-NeXT-7B, Token Retention=320, Reduction Ratio=88.9%2026.02 | 58.8 | — | |
| DUET-VLM (C+S)Visual Token Budget=Avg 192 Tokens2026.02 | 58.5 | — | |
| FastVBackbone=LLaVA-NeXT-7B, Tokens Kept=640, Pruning Ratio=77.8%2025.12 | 58.4 | 97 | |
| DUET-VLM (C)Visual Token Budget=Avg 128 Tokens2026.02 | 58.4 | — | |
| DUET-VLM (C+all)Visual Token Budget=Avg 128 Tokens2026.02 | 58.4 | — | |
| DownsampleFLOPs Savings=4.0×2026.03 | 58.4 | — | |
| VisionZipBackbone=LLaVA-NeXT-7B, Tokens Kept=640, Pruning Ratio=77.8%2025.12 | 58.3 | 96.7 | |
| FlashVLMBackbone=LLaVA-NeXT-7B, Tokens Kept=320, Pruning Ratio=88.9%2025.12 | 58.2 | 94.61 | |
| LLaVA-1.5-7BVisual Token Budget=Total 576 Tokens2026.02 | 58.2 | — | |
| DUET-VLM (C)Visual Token Budget=Avg 192 Tokens2026.02 | 58.2 | — | |
| DUET-VLM (C+S)Visual Token Budget=Avg 128 Tokens2026.02 | 58.1 | — | |
| ApETBackbone=LLaVA-NeXT-7B, Token Retention=640, Reduction Ratio=77.8%2026.02 | 57.9 | — | |
| SparseVLMBackbone=LLaVA-NeXT-7B, Token Retention=640, Reduction Ratio=77.8%2026.02 | 57.8 | — | |
| VisionZipVisual Token Budget=Avg 192 Tokens2026.02 | 57.8 | — | |
| DUET-VLM (C+all)Visual Token Budget=Avg 192 Tokens2026.02 | 57.7 | — | |
| VisPrunerBackbone=LLaVA-NeXT-7B, Tokens Kept=320, Pruning Ratio=88.9%2025.12 | 57.6 | 93.3 | |
| DUET-VLM (C+all)Visual Token Budget=Avg 64 Tokens2026.02 | 57.6 | — | |
| PDropBackbone=LLaVA-NeXT-7B, Token Retention=640, Reduction Ratio=77.8%2026.02 | 57.4 | — | |
| DUET-VLM (C)Visual Token Budget=Avg 64 Tokens2026.02 | 57.2 | — | |
| VisionZipVisual Token Budget=Avg 128 Tokens2026.02 | 57.1 | — | |
| DUET-VLM (C+S)Visual Token Budget=Avg 64 Tokens2026.02 | 57.1 | — | |
| HiREDFLOPs Savings=5.0×2026.03 | 56.8 | — | |
| FlashVLMBackbone=LLaVA-NeXT-7B, Tokens Kept=160, Pruning Ratio=94.4%2025.12 | 56.7 | 88.03 | |
| TAMPBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=TAMP, Pruning Type=unstructured, uniform pruning2026.03 | 56.36 | 73.75 | |
| VisionZipBackbone=LLaVA-NeXT-7B, Token Retention=160, Reduction Ratio=94.4%2026.02 | 56.2 | — | |
| SparseVLMBackbone=LLaVA-NeXT-7B, Tokens Kept=640, Pruning Ratio=77.8%2025.12 | 56.2 | 94.9 | |
| VisPrunerBackbone=LLaVA-NeXT-7B, Tokens Kept=160, Pruning Ratio=94.4%2025.12 | 56 | 86.7 | |
| VisionZipVisual Token Budget=Avg 64 Tokens2026.02 | 56 | — | |
| ATV-PruningBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=ATV-Pruning, Pruning Type=unstructured, uniform pruning2026.03 | 55.83 | 77.01 | |
| FastVBackbone=LLaVA-NeXT-7B, Tokens Kept=320, Pruning Ratio=88.9%2025.12 | 55.7 | 87.7 | |
| VisionZip†FLOPs Savings=5.7×2026.03 | 55.7 | — | |
| JanusFlowType=Und. and Gen. ≤ 2B, # Total Params=2.1B2026.02 | 55.5 | — | |
| PDropBackbone=LLaVA-NeXT-7B, Token Retention=320, Reduction Ratio=88.9%2026.02 | 54.4 | — | |
| ApETBackbone=LLaVA-NeXT-7B, Token Retention=320, Reduction Ratio=88.9%2026.02 | 54.4 | — | |
| WandaBackbone=LLaVA-NeXT 8B, Sparsity Level=60%, Pruning Method=Wanda, Pruning Type=unstructured, uniform pruning2026.03 | 54.37 | 64.45 | |
| ApETBackbone=LLaVA-NeXT-7B, Token Retention=160, Reduction Ratio=94.4%2026.02 | 53.8 | — | |
| VisionZipBackbone=LLaVA-NeXT-7B, Tokens Kept=320, Pruning Ratio=88.9%2025.12 | 53.2 | 90.5 | |
| PDropBackbone=LLaVA-NeXT-7B, Token Retention=160, Reduction Ratio=94.4%2026.02 | 52.7 | — | |
| VisionZipBackbone=LLaVA-NeXT-7B, Tokens Kept=160, Pruning Ratio=94.4%2025.12 | 52.7 | 82.3 | |
| SparseVLMBackbone=LLaVA-NeXT-7B, Tokens Kept=320, Pruning Ratio=88.9%2025.12 | 52.4 | 87.9 | |
| MobileVLM-V2Type=Und. Only > 1B, # Total Params=1.7B2026.02 | 52.1 | — | |
| FastVBackbone=LLaVA-NeXT-7B, Tokens Kept=160, Pruning Ratio=94.4%2025.12 | 51.9 | 74.7 | |
| JanusType=Und. and Gen. ≤ 2B, # Total Params=2.1B2026.02 | 50.2 | — | |
| LLaVA-PhiType=Und. Only > 1B, # Total Params=3.1B2026.02 | 48.6 | — | |
| VisPrunerFLOPs Savings=5.7×2026.03 | 47.8 | — | |
| VisionZipFLOPs Savings=5.7×2026.03 | 46.5 | — | |
| SparseVLMBackbone=LLaVA-NeXT-7B, Token Retention=160, Reduction Ratio=94.4%2026.02 | 46.4 | — | |
| PyramidDropFLOPs Savings=4.2×2026.03 | 45.5 | — | |
| SparseVLMBackbone=LLaVA-NeXT-7B, Tokens Kept=160, Pruning Ratio=94.4%2025.12 | 45.1 | 74.5 | |
| MobileVLMType=Und. Only > 1B, # Total Params=1.7B2026.02 | 41.5 | — | |
| Show-o-Clip-ViTType=Und. and Gen. ≤ 2B, # Total Params=1.6B2026.02 | 41.2 | — |