Multi-image reasoning on MileBench
44.7T-1 ScoreVisionZip
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| VisionZipToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 44.7 | 25.9 | 20.8 | 39.1 | 54 | 30.3 | 6.7 | 25.9 | 69.5 | 12.2 | 9.7 | 30.8 | 96 | |
| ERAToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 42.3 | 33.8 | 18 | 43.9 | 58.5 | 34.8 | 7.9 | 24.6 | 71 | 12.5 | 11.3 | 32.6 | 101.6 | |
| LLaVA-1.5-7BToken retention rate=100%, Backbone=LLaVA-1.5-7B2026.06 | 40.3 | 45.6 | 31.8 | 37.9 | 56.9 | 33.2 | 12.7 | 24.3 | 61 | 5.3 | 4 | 32.1 | 100 | |
| MEDAToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 40.1 | 45.1 | 31.1 | 37.4 | 56.5 | 32.8 | 12.1 | 24 | 60.7 | 4.9 | 4.1 | 31.7 | 98.8 | |
| LOOK-MToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 38.8 | 44 | 30 | 36.3 | 55.4 | 31.3 | 10.9 | 22.8 | 59.2 | 3.5 | 2.6 | 30.4 | 94.8 | |
| H2OToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 37.4 | 42.9 | 29 | 35.1 | 53.8 | 29.5 | 9.8 | 21 | 58.1 | 2.8 | 1.5 | 29.2 | 90.9 | |
| PyramidKVToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 37.1 | 42.7 | 28.8 | 34.9 | 53.9 | 30.1 | 9.6 | 21.1 | 57.8 | 2.1 | 1.4 | 29 | 90.5 | |
| SnapKVToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 36.9 | 42.4 | 28.6 | 34.6 | 53.4 | 29.7 | 9.5 | 21.2 | 57.4 | 1.9 | 1.7 | 28.8 | 89.9 | |
| FastVToken retention rate=10%, Backbone=LLaVA-1.5-7B2026.06 | 32 | 42.4 | 28.2 | 34.2 | 51.1 | 29.7 | 15 | 24.5 | 62 | 5.3 | 3.2 | 29.8 | 92.8 |