Dynamic State Grounding on OmniMMI
43Rank 1 CountGemini-1.5-Pro
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gemini-1.5-ProLLM=Gemini-1.5-Pro, Num Frames=1282025.03 | 43 | 35 | 16.26 | 7.14 | |
| GPT-4oLLM=GPT-4o, Num Frames=502025.03 | 39.5 | 34.33 | 15.57 | 7.65 | |
| VITALLM=Mistrl-8x7B, Num Frames=162025.03 | 39 | 11.33 | 3.11 | 1.52 | |
| VideoLLaMA2LLM=Qwen2-7B, Num Frames=82025.03 | 35 | 23.33 | 4.15 | 0.51 | |
| M4LLM=Qwen2-7B, Num Frames=32 / 1 fps2025.03 | 33.5 | 35.67 | 6.44 | 1.87 | |
| MiniOmini2LLM=Qwen2-0.5B, Num Frames=12025.03 | 14 | 6 | 1 | 0 | |
| M4-aLLM=Qwen2-7B, Num Frames=32 / 1 fps2025.03 | 13 | 19.33 | 3.11 | 0.51 |