STEM on MMMU (val)
44.56AccuracyQwen2.5-Omni-3B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-Omni-3BModel Scale=3B2026.06 | 44.56 | |
| AVLM-2BModel Scale=2B2026.06 | 42.67 | |
| Gemma-4-E2B-itModel Scale=4B2026.06 | 34.78 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Qwen2.5-Omni-3BModel Scale=3B2026.06 | 44.56 | |
| AVLM-2BModel Scale=2B2026.06 | 42.67 | |
| Gemma-4-E2B-itModel Scale=4B2026.06 | 34.78 |