Multi-modal Reasoning on Daily-Omni 10
62.2AV Event Alignment ScoreGemini 2.0 Flash
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.0 FlashLLM Size=-2026.06 | 62.2 | 73.3 | 63.7 | 63.7 | 76.6 | 75.4 | 62.3 | 56.6 | 67.8 | |
| MODF-SIRLLM Size=7B2026.06 | 56.4 | 73.2 | 61.3 | 57.2 | 75.9 | 78.2 | 67.2 | 61.7 | 64.9 | |
| Gemini 2.0 Flash LiteLLM Size=-2026.06 | 55 | 64.9 | 58 | 54.3 | 74 | 72 | 60.6 | 53 | 61.3 | |
| HumanOmniV2LLM Size=7B2026.06 | 46.6 | 67.9 | 51.8 | 51.6 | 72.7 | 74.3 | 63.1 | 53.1 | 58.5 | |
| Qwen2.5-OminiLLM Size=7B2026.06 | 44.1 | 51.2 | 38.9 | 40.5 | 57.8 | 61.7 | 42.4 | 38.4 | 47.5 | |
| OlaLLM Size=7B2026.06 | 40.3 | 60.3 | 39.9 | 44.1 | 61 | 66.3 | 50.9 | 48.7 | 49.9 | |
| MiniCPM-oLLM Size=7B2026.06 | 40.3 | 61.1 | 49.2 | 48.4 | 68.8 | 61.1 | 54.1 | 52 | 53.1 | |
| Qwen2.5-OmniLLM Size=3B2026.06 | 38.7 | 48.1 | 33.7 | 34 | 54.56 | 44 | 46.7 | 48.4 | 40.5 | |
| VideoLLaMA2LLM Size=7B2026.06 | 35.7 | 35.9 | 35.8 | 31.7 | 40.9 | 34.3 | 38 | 31.8 | 35.2 | |
| Unified-IO-2LLM Size=8B2026.06 | 25.6 | 31.3 | 26.4 | 25.8 | 35.1 | 29.7 | 26.7 | 30 | 28.2 |