Multimodal Reasoning on AI2D (test)
55.44AccuracyALVTS
Evaluation results
| Method | Links | |
|---|---|---|
| ALVTSTokens Retained=192, Reduction Ratio=67%2026.06 | 55.44 | |
| LLaVA-1.5-7BTokens Retained=576, Retention Ratio=100%2026.06 | 55.21 | |
| VTWTokens Retained=192, Reduction Ratio=67%2026.06 | 54.99 | |
| FastVTokens Retained=192, Reduction Ratio=67%2026.06 | 54.73 | |
| DARTTokens Retained=192, Reduction Ratio=67%2026.06 | 54.73 | |
| ALVTSTokens Retained=64, Reduction Ratio=89%2026.06 | 54.63 | |
| ALVTSTokens Retained=128, Reduction Ratio=78%2026.06 | 54.57 | |
| PDropTokens Retained=192, Reduction Ratio=67%2026.06 | 54.4 | |
| DARTTokens Retained=128, Reduction Ratio=78%2026.06 | 54.37 | |
| FastVTokens Retained=128, Reduction Ratio=78%2026.06 | 54.02 | |
| PDropTokens Retained=128, Reduction Ratio=78%2026.06 | 53.92 | |
| DARTTokens Retained=64, Reduction Ratio=89%2026.06 | 53.59 | |
| FastVTokens Retained=64, Reduction Ratio=89%2026.06 | 53.56 | |
| PDropTokens Retained=64, Reduction Ratio=89%2026.06 | 53.3 | |
| VTWTokens Retained=128, Reduction Ratio=78%2026.06 | 53.04 | |
| VTWTokens Retained=64, Reduction Ratio=89%2026.06 | 50.26 |