Multimodal Reasoning on RealWorldQA (test)
56.08AccuracyLLaVA-1.5-7B
Evaluation results
| Method | Links | |
|---|---|---|
| LLaVA-1.5-7BTokens Retained=576, Retention Ratio=100%2026.06 | 56.08 | |
| ALVTSTokens Retained=192, Reduction Ratio=67%2026.06 | 54.64 | |
| DARTTokens Retained=192, Reduction Ratio=67%2026.06 | 54.25 | |
| DARTTokens Retained=128, Reduction Ratio=78%2026.06 | 53.99 | |
| ALVTSTokens Retained=128, Reduction Ratio=78%2026.06 | 53.99 | |
| FastVTokens Retained=192, Reduction Ratio=67%2026.06 | 53.33 | |
| PDropTokens Retained=192, Reduction Ratio=67%2026.06 | 53.2 | |
| ALVTSTokens Retained=64, Reduction Ratio=89%2026.06 | 53.2 | |
| PDropTokens Retained=128, Reduction Ratio=78%2026.06 | 51.37 | |
| FastVTokens Retained=128, Reduction Ratio=78%2026.06 | 51.11 | |
| DARTTokens Retained=64, Reduction Ratio=89%2026.06 | 50.85 | |
| VTWTokens Retained=192, Reduction Ratio=67%2026.06 | 50.46 | |
| PDropTokens Retained=64, Reduction Ratio=89%2026.06 | 47.97 | |
| FastVTokens Retained=64, Reduction Ratio=89%2026.06 | 47.32 | |
| VTWTokens Retained=128, Reduction Ratio=78%2026.06 | 44.05 | |
| VTWTokens Retained=64, Reduction Ratio=89%2026.06 | 43.53 |