Video Perception and Reasoning on Perception (test)
74AccuracyOryx-1.5
Evaluation Results
| Method | Links | |
|---|---|---|
| Oryx-1.5Size=32B2024.09 | 74 | |
| OryxSize=34B2024.09 | 71.4 | |
| Oryx-1.5Size=7B2024.09 | 70 | |
| OryxSize=7B2024.09 | 68.6 | |
| LLaVA-OneVisionSize=72B2024.09 | 66.9 | |
| VideoLLaMA2Size=72B2024.09 | 57.5 | |
| VILA-1.5Size=40B2024.09 | 54 | |
| LLaVA-Next-VideoSize=34B2024.09 | 51.6 | |
| VideoLLaMA2Size=7B2024.09 | 51.4 | |
| LLaVA-OneVisionSize=7B2024.09 | 49.7 | |
| VideoChat2-HDSize=7B2024.09 | 47.3 | |
| GPT-4VSize=not specified2024.09 | 43.7 |