Streaming Video Question Answering on StreamingBench Real-Time (test)
74OPMuKV
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MuKVSize=7B, #Inf. Tok=8.3K, # Mem. Tok=59K2026.05 | 74 | 78.2 | 72.2 | 71.8 | 64.8 | 55.5 | 66.7 | 58.9 | 59.4 | 39.4 | 64.4 | |
| ReKVSize=7B, #Inf. Tok=12.5K, # Mem. Tok=59K2026.05 | 71.3 | 70.3 | 69.1 | 68.6 | 61.6 | 55.2 | 63.9 | 58.1 | 55.7 | 46.3 | 62.3 | |
| LongVA (128F)Size=7B, #Inf. Tok=18.4K, # Mem. Tok=02026.05 | 70 | 63.3 | 61.2 | 70.9 | 62.7 | 59.5 | 61.1 | 53.7 | 54.7 | 34.7 | 60 | |
| MuKVSize=0.5B, #Inf. Tok=8.3K, # Mem. Tok=59K2026.05 | 60.7 | 67.2 | 65 | 63.5 | 61 | 51.7 | 63 | 50.1 | 54 | 32.4 | 56.8 | |
| ReKVSize=0.5B, #Inf. Tok=12.5K, # Mem. Tok=59K2026.05 | 55.3 | 57 | 61.2 | 60.5 | 56 | 50.1 | 48.1 | 46.3 | 51.1 | 33 | 52.7 | |
| FVStreamSize=7B2026.05 | 27.1 | 45.4 | 25.9 | 25 | 28.5 | 13.6 | 19.4 | 26.3 | 24.9 | 50.2 | 24.3 |