Multi-turn Visual Dialogue on MMDU 45K
3.79AccuracyDBTrimKV
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DBTrimKVBudget=5122026.05 | 3.79 | 4.09 | 114.46 | |
| DBTrimKVBudget=2562026.05 | 3.64 | 3.87 | 108.33 | |
| TrimKVBudget=5122026.05 | 3.46 | 3.73 | 104.51 | |
| DBTrimKVBudget=1282026.05 | 3.43 | 3.72 | 104.1 | |
| VanillaBudget=5122026.05 | 3.37 | 3.57 | 100 | |
| VanillaBudget=2562026.05 | 3.37 | 3.57 | 100 | |
| VanillaBudget=1282026.05 | 3.37 | 3.57 | 100 | |
| TrimKVBudget=2562026.05 | 3.16 | 3.56 | 99.65 | |
| SnapKVBudget=5122026.05 | 3.07 | 3.46 | 96.7 | |
| TrimKVBudget=1282026.05 | 3.05 | 3.35 | 93.61 | |
| AdaKVBudget=5122026.05 | 2.89 | 3.24 | 90.79 | |
| R-KVBudget=5122026.05 | 2.76 | 3 | 84 | |
| AdaKVBudget=2562026.05 | 2.56 | 2.88 | 80.68 | |
| SnapKVBudget=2562026.05 | 2.54 | 2.88 | 80.51 | |
| R-KVBudget=2562026.05 | 2.42 | 2.66 | 74.45 | |
| AdaKVBudget=1282026.05 | 2.03 | 2.25 | 62.98 | |
| R-KVBudget=1282026.05 | 2.02 | 2.17 | 60.77 | |
| SnapKVBudget=1282026.05 | 2.01 | 2.29 | 64 |