Image Reasoning on MMMU Pro Vision
43.87AccuracyDBTrimKV
Evaluation Results
| Method | Links | |
|---|---|---|
| DBTrimKVBudget=5122026.05 | 43.87 | |
| DBTrimKVBudget=2562026.05 | 41.85 | |
| DBTrimKVBudget=10242026.05 | 41.1 | |
| VanillaBudget=Full2026.05 | 40.64 | |
| DBTrimKVBudget=1282026.05 | 40.41 | |
| TrimKVBudget=10242026.05 | 34.34 | |
| TrimKVBudget=5122026.05 | 34.34 | |
| DBTrimKVBudget=642026.05 | 32.49 | |
| TrimKVBudget=2562026.05 | 31.45 | |
| R-KVBudget=10242026.05 | 26.24 | |
| Ada-Pyramid-KVBudget=10242026.05 | 25.9 | |
| AdaKVBudget=10242026.05 | 25.61 | |
| TrimKVBudget=1282026.05 | 24.34 | |
| SnapKVBudget=10242026.05 | 18.27 | |
| AdaKVBudget=5122026.05 | 16.99 | |
| Ada-Pyramid-KVBudget=5122026.05 | 15.61 | |
| R-KVBudget=5122026.05 | 15.54 | |
| TrimKVBudget=642026.05 | 13.24 | |
| R-KVBudget=2562026.05 | 12.37 | |
| SnapKVBudget=5122026.05 | 9.36 | |
| AdaKVBudget=2562026.05 | 8.27 | |
| Ada-Pyramid-KVBudget=2562026.05 | 8.09 | |
| SnapKVBudget=2562026.05 | 6.24 | |
| R-KVBudget=1282026.05 | 4.51 | |
| AdaKVBudget=1282026.05 | 4.14 | |
| Ada-Pyramid-KVBudget=1282026.05 | 4.05 | |
| SnapKVBudget=1282026.05 | 2.66 |