Document Visual Question Answering on DocVQA (Accuracy)
95.75AccuracyBase
Evaluation Results
| Method | Links | |
|---|---|---|
| BasePruning Ratio=100%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 95.75 | |
| ERASEPruning Ratio=-65.11%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 95.44 | |
| IVC-PrunePruning Ratio=-65.11%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 95.31 | |
| ERASEPruning Ratio=-72.77%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 95 | |
| IVC-PrunePruning Ratio=-72.77%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 94.97 | |
| DeFactoBackbone=Qwen2.5-VL-7B2025.09 | 94 | |
| C-RADIOv4-HTokens per frame/tile=256, TTFT (ms)=468.2, LLM Backbone=9B Nemotron2026.07 | 93.3 | |
| ERASEPruning Ratio=-84.43%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 93.21 | |
| RADIO1DTokens per frame/tile=192, TTFT (ms)=380.4, LLM Backbone=9B Nemotron2026.07 | 93.2 | |
| RADIO1DTokens per frame/tile=256, TTFT (ms)=452.8, LLM Backbone=9B Nemotron2026.07 | 93.2 | |
| RADIO1DTokens per frame/tile=224, TTFT (ms)=410.2, LLM Backbone=9B Nemotron2026.07 | 93 | |
| SigLIP2-SO400mTokens per frame/tile=256, TTFT (ms)=440.5, LLM Backbone=9B Nemotron2026.07 | 92.9 | |
| SigLIP2-gTokens per frame/tile=256, TTFT (ms)=517.6, LLM Backbone=9B Nemotron2026.07 | 92.8 | |
| RADIO1DTokens per frame/tile=128, TTFT (ms)=373.2, LLM Backbone=9B Nemotron2026.07 | 92.5 | |
| Qwen2.5-VLBackbone=Qwen2.5-VL-7B2025.09 | 92 | |
| IVC-PrunePruning Ratio=-84.43%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 91.02 | |
| RADIO1DTokens per frame/tile=64, TTFT (ms)=346.1, LLM Backbone=9B Nemotron2026.07 | 90.6 | |
| PruneSIDPruning Ratio=-65.11%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 90.51 | |
| RADIO1DTokens per frame/tile=32, TTFT (ms)=335.1, LLM Backbone=9B Nemotron2026.07 | 88.1 | |
| PruneSIDPruning Ratio=-72.77%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 85.77 | |
| Visual-SR1Backbone=Qwen2.5-VL-7B2025.09 | 84.9 | |
| iLLaVAPruning Ratio=-65.11%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 84.89 | |
| VicropModel=Qwen2.5-VL 7B2025.09 | 81.8 | |
| HiDeModel=Qwen2.5-VL 7B2025.09 | 81.8 | |
| Qwen2.5-VL 7BModel=Qwen2.5-VL 7B2025.09 | 81.7 | |
| iLLaVAPruning Ratio=-72.77%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 79.63 | |
| RADIO1DTokens per frame/tile=8, TTFT (ms)=329.7, LLM Backbone=9B Nemotron2026.07 | 79.5 | |
| DARTPruning Ratio=-65.11%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 74.9 | |
| PruneSIDPruning Ratio=-84.43%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 68.86 | |
| iLLaVAPruning Ratio=-84.43%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 67.64 | |
| DeepEyesBackbone=Qwen2.5-VL-7B2025.09 | 67.1 | |
| DARTPruning Ratio=-72.77%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 64.99 | |
| CDPrunerPruning Ratio=-65.11%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 63.06 | |
| GRITBackbone=Qwen2.5-VL-3B2025.09 | 57 | |
| CDPrunerPruning Ratio=-72.77%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 54.53 | |
| VRCDdecoding length (L)=384, forward ratio (FR)=0.52026.05 | 54.33 | |
| IGdecoding length (L)=384, forward ratio (FR)=0.52026.05 | 54.05 | |
| Confidencedecoding length (L)=384, forward ratio (FR)=0.52026.05 | 53.74 | |
| Margindecoding length (L)=384, forward ratio (FR)=0.52026.05 | 53.74 | |
| Entropydecoding length (L)=384, forward ratio (FR)=0.52026.05 | 52.93 | |
| VRCDdecoding length (L)=384, forward ratio (FR)=0.252026.05 | 52.24 | |
| RADIO1DTokens per frame/tile=1, TTFT (ms)=327.0, LLM Backbone=9B Nemotron2026.07 | 51.1 | |
| Margindecoding length (L)=384, forward ratio (FR)=0.252026.05 | 50.57 | |
| IGdecoding length (L)=384, forward ratio (FR)=0.252026.05 | 50.51 | |
| Confidencedecoding length (L)=384, forward ratio (FR)=0.252026.05 | 50.41 | |
| Entropydecoding length (L)=384, forward ratio (FR)=0.252026.05 | 49.93 | |
| VRCDdecoding length (L)=384, forward ratio (FR)=0.1252026.05 | 49.22 | |
| Margindecoding length (L)=384, forward ratio (FR)=0.1252026.05 | 46.54 | |
| IGdecoding length (L)=384, forward ratio (FR)=0.1252026.05 | 46.48 | |
| Confidencedecoding length (L)=384, forward ratio (FR)=0.1252026.05 | 46.45 | |
| Entropydecoding length (L)=384, forward ratio (FR)=0.1252026.05 | 46.39 | |
| DARTPruning Ratio=-84.43%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 44.94 | |
| CDPrunerPruning Ratio=-84.43%, Base Model=Qwen3-VL-8B, Zero-shot evaluation=True2026.05 | 38.49 | |
| ViCropBackbone=LLaVA-1.5 (Vicuna-7B)2025.09 | 31.8 |