Multi-turn Dependency Reasoning on OmniMMI
52.33Rank 1 ScoreGemini-1.5-Pro
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gemini-1.5-ProLLM=Gemini-1.5-Pro, Num Frames=1282025.03 | 52.33 | 19.67 | 9.35 | 16.33 | |
| GPT-4oLLM=GPT-4o, Num Frames=502025.03 | 48.67 | 16.95 | 5.61 | 15 | |
| VideoLLaMA2LLM=Qwen2-7B, Num Frames=82025.03 | 41 | 12.88 | 0 | 10.33 | |
| M4LLM=Qwen2-7B, Num Frames=32 / 1 fps2025.03 | 35.67 | 6.44 | 1.87 | 5.67 | |
| M4-aLLM=Qwen2-7B, Num Frames=32 / 1 fps2025.03 | 28.33 | 2.37 | 0 | 2 | |
| MiniOmini2LLM=Qwen2-0.5B, Num Frames=12025.03 | 17 | 5.08 | 0.93 | 4.67 | |
| VITALLM=Mistrl-8x7B, Num Frames=162025.03 | 8.67 | 0 | 0 | 0 |