Streaming Video Question Answering on VStream-QA RVSEgo (test)
63.7AccuracyReKV
Evaluation results
| Method | Links | |
|---|---|---|
| ReKVSize=7B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo-06132026.05 | 63.7 | |
| MuKVSize=7B, #Inf. Tok=8.3K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 59.5 | |
| FVStreamSize=7B, Evaluation Protocol=GPT-3.5-turbo-06132026.05 | 59 | |
| FVStreamSize=7B, Evaluation Protocol=GPT-3.5-turbo2026.05 | 58.5 | |
| MuKVSize=0.5B, #Inf. Tok=8.3K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 57.9 | |
| ReKVSize=7B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 56.2 | |
| ReKVSize=0.5B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo-06132026.05 | 54.7 | |
| ReKVSize=0.5B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 51.5 |