Video Reasoning on VideoMMMU comprehension
61.33AccuracyDBTrimKV
Evaluation Results
| Method | Links | |
|---|---|---|
| DBTrimKVBudget=5122026.05 | 61.33 | |
| DBTrimKVBudget=10242026.05 | 59.33 | |
| TrimKVBudget=10242026.05 | 59 | |
| DBTrimKVBudget=2562026.05 | 57 | |
| DBTrimKVBudget=1282026.05 | 57 | |
| VanillaBudget=Full2026.05 | 55 | |
| TrimKVBudget=5122026.05 | 51.51 | |
| DBTrimKVBudget=642026.05 | 42.67 | |
| TrimKVBudget=2562026.05 | 42.48 | |
| AdaKVBudget=10242026.05 | 31.67 | |
| Ada-Pyramid-KVBudget=10242026.05 | 30.74 | |
| R-KVBudget=10242026.05 | 30.33 | |
| SnapKVBudget=10242026.05 | 28.67 | |
| TrimKVBudget=1282026.05 | 28.38 | |
| AdaKVBudget=5122026.05 | 24.67 | |
| R-KVBudget=5122026.05 | 21.84 | |
| SnapKVBudget=5122026.05 | 21.4 | |
| Ada-Pyramid-KVBudget=5122026.05 | 19.46 | |
| AdaKVBudget=2562026.05 | 18.77 | |
| TrimKVBudget=642026.05 | 18.18 | |
| R-KVBudget=2562026.05 | 17.27 | |
| Ada-Pyramid-KVBudget=2562026.05 | 15.17 | |
| SnapKVBudget=2562026.05 | 14.92 | |
| Ada-Pyramid-KVBudget=1282026.05 | 13.57 | |
| SnapKVBudget=1282026.05 | 13.06 | |
| R-KVBudget=1282026.05 | 11.03 | |
| AdaKVBudget=1282026.05 | 9.59 |