Science Question Answering on ScienceQA Image
100.7Relative PerformanceDART
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DARTRetained Tokens=640, Token Reduction Ratio=77.8%, Backbone=LLaVA-NeXT-13B2026.06 | 100.7 | 73.7 | |
| OriginalPrecision (Pre.)=FP16, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 100 | 88.25 | |
| LLaVA-NeXT-13BRetained Tokens=2880, Token Reduction Ratio=100%, Backbone=LLaVA-NeXT-13B2026.06 | 100 | 73.1 | |
| SPARERetained Tokens=640, Token Reduction Ratio=77.8%, Backbone=LLaVA-NeXT-13B2026.06 | 99.1 | 71.4 | |
| CDPrunerRetained Tokens=640, Token Reduction Ratio=77.8%, Backbone=LLaVA-NeXT-13B2026.06 | 98.3 | 71.9 | |
| Quant.Precision (Pre.)=W4A4, Keep Ratio=100%, GFLOPs=100.00%2026.04 | 97.53 | 86.07 | |
| SPARERetained Tokens=320, Token Reduction Ratio=88.9%, Backbone=LLaVA-NeXT-13B2026.06 | 97.2 | 70.7 | |
| CDPrunerRetained Tokens=320, Token Reduction Ratio=88.9%, Backbone=LLaVA-NeXT-13B2026.06 | 97.1 | 71.1 | |
| QUOTAPrecision (Pre.)=W4A4, Keep Ratio=30%, GFLOPs=55.80%2026.04 | 96.85 | 85.47 | |
| FastVPrecision (Pre.)=FP16, Keep Ratio=30%, GFLOPs=32.66%2026.04 | 96.48 | — | |
| DARTRetained Tokens=320, Token Reduction Ratio=88.9%, Backbone=LLaVA-NeXT-13B2026.06 | 96.3 | 72.1 | |
| SPARERetained Tokens=160, Token Reduction Ratio=94.4%, Backbone=LLaVA-NeXT-13B2026.06 | 95.6 | 70.8 | |
| PruningPrecision (Pre.)=FP16, Keep Ratio=30%, GFLOPs=55.80%2026.04 | 95.33 | 84.13 | |
| CDPrunerRetained Tokens=160, Token Reduction Ratio=94.4%, Backbone=LLaVA-NeXT-13B2026.06 | 95.2 | 70.4 | |
| DivPrunePrecision (Pre.)=FP16, Keep Ratio=25%, GFLOPs=24.45%2026.04 | 95.18 | — | |
| PDropPrecision (Pre.)=FP16, Keep Ratio=30%, GFLOPs=33.03%2026.04 | 94.65 | — | |
| VTWPrecision (Pre.)=FP16, Keep Ratio=40%, GFLOPs=43.43%2026.04 | 90.87 | — | |
| DARTRetained Tokens=160, Token Reduction Ratio=94.4%, Backbone=LLaVA-NeXT-13B2026.06 | 89.4 | 71.3 |