STEM Lecture Comprehension on VideoMMLU
49.4AccuracyGPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4oSize=-, Evaluation Frames=642026.03 | 49.4 | 57.8 | |
| Insight-V++Size=7B, Evaluation Frames=642026.03 | 48.4 | 54.2 | |
| Insight-VSize=7B, Evaluation Frames=642026.03 | 46.8 | 52.9 | |
| Gemini-1.5-FlashSize=-, Evaluation Frames=642026.03 | 43.6 | — | |
| InternVL2.5Size=8B, Evaluation Frames=642026.03 | 39.5 | — | |
| MiniCPM-V 2.6Size=8B, Evaluation Frames=642026.03 | 39.3 | — | |
| Qwen2.5-VLSize=7B, Evaluation Frames=642026.03 | 37.5 | 47.3 | |
| LLaVA-OneVisionSize=7B, Evaluation Frames=642026.03 | 34 | — | |
| VideoChat-FlashSize=7B, Evaluation Frames=642026.03 | 27.7 | — | |
| LLaVA-VideoSize=7B, Evaluation Frames=642026.03 | 21.5 | — |