Omnimodal Understanding on WorldSense (test)
54.7Tech & Science ScoreMODF-SIR
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MODF-SIRLLM Size=7B2026.06 | 54.7 | 58.2 | 50.3 | 49.6 | 52.1 | 51.5 | 47.7 | 50 | 51.5 | |
| Gemini 1.5 ProLLM Size=-2026.06 | 53.7 | 47.2 | 50.3 | 5.4 | 52.4 | 46.8 | 40.2 | 42 | 48 | |
| HumanOmniV2LLM Size=7B2026.06 | 50.2 | 51.7 | 47.6 | 44.8 | 47.3 | 44.3 | 45.2 | 44.2 | 47.1 | |
| GPT 4oLLM Size=-2026.06 | 48 | 44 | 38.3 | 43.5 | 41.9 | 41.2 | 42.6 | 42.6 | 42.6 | |
| Qwen2.5-OminiLLM Size=7B2026.06 | 47.8 | 49.8 | 43.6 | 43.8 | 48.3 | 39.1 | 43.5 | 47.3 | 45.4 | |
| Claude 3.5 SonnetLLM Size=-2026.06 | 43.7 | 31.7 | 30.6 | 36.5 | 30.7 | 31.9 | 36.6 | 33.9 | 34.8 | |
| VITA-1.5LLM Size=7B2026.06 | 38.2 | 35.9 | 34.3 | 39.8 | 41.2 | 32.6 | 34.7 | 39.9 | 36.9 | |
| VideoLLaMA2LLM Size=7B2026.06 | 29.4 | 25.4 | 21.8 | 24.5 | 26.2 | 24.6 | 25.5 | 27.1 | 25.4 | |
| Unified-IO-2 XXLLLM Size=7B2026.06 | 27.1 | 31.7 | 23.9 | 23.7 | 25.5 | 23.7 | 25.7 | 27.3 | 25.9 |