Science Question Answering on ScienceQA (SQA and Retention Metrics)
86.81SQA ScoreQwen3VL-2B-SFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3VL-2B-SFTTokens=-2026.05 | 86.81 | — | |
| ETCTokens=42026.05 | 85.48 | — | |
| ETCTokens=22026.05 | 85.23 | — | |
| ETCTokens=12026.05 | 84.43 | — | |
| VoCoTokens=42026.05 | 84.38 | — | |
| VoCoTokens=22026.05 | 83.63 | — | |
| VoCoTokens=12026.05 | 82.94 | — | |
| DiffPruneBase Model=LLaVA-NEXT-7B, Token Budget=320, Pruning Rate=88.9%, Loc. (Pruning Location)=Pre2026.05 | 72.7 | 96.1 | |
| VanillaBase Model=LLaVA-NEXT-7B, Token Budget=2880, Pruning Rate=0%, Loc. (Pruning Location)=-2026.05 | 70.1 | 100 | |
| HoloVBase Model=LLaVA-NEXT-7B, Token Budget=320, Pruning Rate=88.9%, Loc. (Pruning Location)=Pre2026.05 | 68.9 | 95.7 | |
| DARTBase Model=LLaVA-NEXT-7B, Token Budget=320, Pruning Rate=88.9%, Loc. (Pruning Location)=L22026.05 | 68.4 | 95.6 | |
| PDropBase Model=LLaVA-NEXT-7B, Token Budget=320, Pruning Rate=88.9%, Loc. (Pruning Location)=L8–L242026.05 | 67.5 | 90.7 | |
| Qwen3VL-2B-SFTTokens=02026.05 | 67.37 | — | |
| HiREDBase Model=LLaVA-NEXT-7B, Token Budget=320, Pruning Rate=88.9%, Loc. (Pruning Location)=Pre2026.05 | 66.7 | 93.4 | |
| FastVBase Model=LLaVA-NEXT-7B, Token Budget=320, Pruning Rate=88.9%, Loc. (Pruning Location)=L2–L322026.05 | 62.8 | 87.6 | |
| LLaMA-VIDTokens=42026.05 | 53.69 | — | |
| LLaMA-VIDTokens=22026.05 | 52.94 | — | |
| QueCCTokens=12026.05 | 30 | — | |
| QueCCTokens=42026.05 | 28.84 | — |