Video Reasoning on VideoMMMU adaptation
39AccuracyDBTrimKV
Evaluation Results
| Method | Links | |
|---|---|---|
| DBTrimKVBudget=2562026.05 | 39 | |
| DBTrimKVBudget=10242026.05 | 37 | |
| VanillaBudget=Full2026.05 | 35.67 | |
| DBTrimKVBudget=5122026.05 | 35.57 | |
| TrimKVBudget=10242026.05 | 35 | |
| DBTrimKVBudget=1282026.05 | 34.33 | |
| TrimKVBudget=5122026.05 | 34 | |
| TrimKVBudget=2562026.05 | 30.67 | |
| Ada-Pyramid-KVBudget=10242026.05 | 28.96 | |
| DBTrimKVBudget=642026.05 | 28.67 | |
| AdaKVBudget=10242026.05 | 25.42 | |
| TrimKVBudget=1282026.05 | 22.9 | |
| SnapKVBudget=5122026.05 | 22.74 | |
| AdaKVBudget=5122026.05 | 22.15 | |
| R-KVBudget=10242026.05 | 22 | |
| SnapKVBudget=10242026.05 | 21 | |
| R-KVBudget=5122026.05 | 20.4 | |
| Ada-Pyramid-KVBudget=5122026.05 | 19.73 | |
| TrimKVBudget=642026.05 | 18.4 | |
| AdaKVBudget=2562026.05 | 17.41 | |
| SnapKVBudget=2562026.05 | 17.11 | |
| Ada-Pyramid-KVBudget=2562026.05 | 16.9 | |
| AdaKVBudget=1282026.05 | 16.38 | |
| Ada-Pyramid-KVBudget=1282026.05 | 15.99 | |
| SnapKVBudget=1282026.05 | 14.58 | |
| R-KVBudget=2562026.05 | 14.38 | |
| R-KVBudget=1282026.05 | 11.38 |