Streaming Video Question Answering on VStream-QA RVSMovie (test)
56.1AccuracyFVStream
Evaluation results
| Method | Links | |
|---|---|---|
| FVStreamSize=7B, Evaluation Protocol=GPT-3.5-turbo-06132026.05 | 56.1 | |
| FVStreamSize=7B, Evaluation Protocol=GPT-3.5-turbo2026.05 | 54.7 | |
| ReKVSize=7B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo-06132026.05 | 54.4 | |
| MuKVSize=7B, #Inf. Tok=8.3K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 48.5 | |
| ReKVSize=7B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 48.2 | |
| MuKVSize=0.5B, #Inf. Tok=8.3K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 45.2 | |
| ReKVSize=0.5B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo-06132026.05 | 44.6 | |
| ReKVSize=0.5B, #Inf. Tok=12.5K, # Mem. Tok=59K, Evaluation Protocol=GPT-3.5-turbo2026.05 | 42.3 |