Science Question Answering on SQA (SQA, Avg %)
97SQA ScoreVanilla
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VanillaBackbone=InternVL2-8B, Retention Rate=100%2026.05 | 97 | 100 | |
| LightKVBackbone=InternVL2-8B, Retention Rate=60%2026.05 | 97 | 100.19 | |
| LightKVBackbone=InternVL2-8B, Retention Rate=55%2026.05 | 97 | 99.58 | |
| ToMe (P)Backbone=InternVL2-8B, Retention Rate=60%2026.05 | 95 | 97.86 | |
| ToMe (P)Backbone=InternVL2-8B, Retention Rate=55%2026.05 | 95 | 95.62 | |
| ToFuBackbone=InternVL2-8B, Retention Rate=55%2026.05 | 95 | 95.82 | |
| ToFuBackbone=InternVL2-8B, Retention Rate=60%2026.05 | 94 | 95.49 | |
| PiToMeBackbone=InternVL2-8B, Retention Rate=60%2026.05 | 90 | 95.99 | |
| PiToMeBackbone=InternVL2-8B, Retention Rate=55%2026.05 | 90 | 95.54 | |
| QueCCTokens=12026.05 | 69.9 | — | |
| LLaVA-1.5-7BTokens=5762026.05 | 69.56 | 100 | |
| LLaMA-VIDTokens=22026.05 | 68.8 | — | |
| ETCTokens=42026.05 | 68.76 | 95.33 | |
| LLaMA-VIDTokens=42026.05 | 68.7 | — | |
| ETCTokens=22026.05 | 68.47 | 94.55 | |
| ETCTokens=12026.05 | 67.63 | 92.22 | |
| VoCoTokens=12026.05 | 65.4 | — | |
| MQT-LLaVATokens=42026.05 | 65.1 | — | |
| MQT-LLaVATokens=22026.05 | 65 | — | |
| LLaVA-1.5-7BTokens=02026.05 | 63.6 | — | |
| FastVBackbone=InternVL2-8B, Retention Rate=60%2026.05 | 49 | 81.9 | |
| FastVBackbone=InternVL2-8B, Retention Rate=55%2026.05 | 46 | 79.49 |