Multi-modal Inference on Qwen3-VL-2B (inference)
2,514.9Total LatencyCIVIC
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CIVIC2026.05 | 2,514.9 | 32.53 | 0.16 | 18.94 | 2,229.4 | 2,248.3 | 0.49 | 407.9 | 44.61 | |
| Baseline2026.05 | 3,543 | 47.82 | 0.39 | 35.2 | 3,128.4 | 3,274.3 | 0 | 1,122.2 | 122.7 | |
| ZOO-Prune2026.05 | 3,564.3 | 47.8 | 0.38 | 27.2 | 3,141.2 | 3,168.4 | 18.45 | 848.5 | 92.81 | |
| DyMU2026.05 | 3,688.2 | 96.74 | 0.4 | 34.04 | 3,224.2 | 3,258.2 | 9.28 | 1,122.2 | 122.7 | |
| DynamicViTToken reduction strategy=hard shrink2026.05 | 3,785.3 | 52.98 | 0.39 | 34.43 | 3,346.6 | 3,381.1 | 3.45 | 1,122.2 | 122.7 | |
| DiffRate2026.05 | 3,804.9 | 115.9 | 0.42 | 33.95 | 3,311.2 | 3,345.1 | 1.26 | 1,122.2 | 122.7 | |
| DynamicViTToken reduction strategy=soft gumbel2026.05 | 4,132.6 | 186.5 | 0.39 | 34.51 | 3,543.5 | 3,578 | 2.62 | 1,122.2 | 122.7 | |
| VisionTrim2026.05 | 4,207.5 | 47.71 | 0.38 | 26.4 | 3,734.9 | 3,761.3 | 3.96 | 848.5 | 92.81 |