Image Reasoning on MathVision mini
52.63AccuracyDBTrimKV
Evaluation Results
| Method | Links | |
|---|---|---|
| DBTrimKVBudget=10242026.05 | 52.63 | |
| DBTrimKVBudget=5122026.05 | 51.97 | |
| DBTrimKVBudget=2562026.05 | 51.64 | |
| VanillaBudget=Full2026.05 | 48.68 | |
| DBTrimKVBudget=1282026.05 | 47.04 | |
| TrimKVBudget=10242026.05 | 45.72 | |
| TrimKVBudget=5122026.05 | 42.11 | |
| TrimKVBudget=2562026.05 | 40.79 | |
| DBTrimKVBudget=642026.05 | 33.88 | |
| AdaKVBudget=10242026.05 | 32.89 | |
| Ada-Pyramid-KVBudget=10242026.05 | 28.29 | |
| TrimKVBudget=1282026.05 | 27.3 | |
| R-KVBudget=10242026.05 | 24.67 | |
| R-KVBudget=5122026.05 | 20.72 | |
| AdaKVBudget=5122026.05 | 17.11 | |
| R-KVBudget=2562026.05 | 16.12 | |
| Ada-Pyramid-KVBudget=5122026.05 | 15.46 | |
| SnapKVBudget=10242026.05 | 15.13 | |
| SnapKVBudget=5122026.05 | 14.8 | |
| TrimKVBudget=642026.05 | 12.17 | |
| AdaKVBudget=2562026.05 | 8.55 | |
| Ada-Pyramid-KVBudget=2562026.05 | 8.22 | |
| R-KVBudget=1282026.05 | 8.22 | |
| SnapKVBudget=2562026.05 | 7.89 | |
| Ada-Pyramid-KVBudget=1282026.05 | 3.62 | |
| AdaKVBudget=1282026.05 | 2.96 | |
| SnapKVBudget=1282026.05 | 1.64 |