Multiple-Choice Video QA on Perception latest (test)
59.3AccuracyReka-Core
Evaluation results
| Method | Links | |
|---|---|---|
| Reka-Core2024.06 | 59.3 | |
| VideoLLaMA2Model Scale=72B, #Frames=162024.06 | 57.5 | |
| Reka-Flash2024.06 | 56.4 | |
| VideoLLaMA2.1Model Scale=7B, #Frames=162024.06 | 54.9 | |
| Gemini 1.0 Ultra2024.06 | 54.7 | |
| VideoLLaMA2Model Scale=8x7B, #Frames=82024.06 | 52.2 | |
| VideoLLaMA2Model Scale=7B, #Frames=162024.06 | 51.4 | |
| Gemini 1.0 Pro2024.06 | 51.1 | |
| VideoLLaMA2Model Scale=7B, #Frames=82024.06 | 49.6 | |
| LLaVA-NeXT-VideoModel Scale=7B, #Frames=322024.06 | 48.8 | |
| VideoChat2Model Scale=7B, #Frames=162024.06 | 47.3 | |
| LLAMA-VIDModel Scale=7B, #Frames=1 fps2024.06 | 44.6 | |
| Video-LLaVAModel Scale=7B, #Frames=82024.06 | 44.3 |