Knowledge on MMLU-Redux
90Knowledge (MMLU-Redux) ScoreQwen3.5-Omni Flash 35B-A3B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3.5-Omni Flash 35B-A3BContext Length=256K2026.07 | 90 | |
| Qwen3-Omni 30B-A3B ThinkingContext Length=64K2026.07 | 88.8 | |
| Step-Audio R1.1 33BContext Length=64K2026.07 | 86.6 | |
| Audex 30B-A3BContext Length=1M2026.07 | 86.4 | |
| Qwen3-14B + NGMModel Scale=14B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 85.3 | |
| Qwen3-14BModel Scale=14B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 84.88 | |
| Qwen3-8B + NGMModel Scale=8B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 81.26 | |
| Qwen3-8BModel Scale=8B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 80.65 | |
| Qwen3-4BModel Scale=4B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 79.61 | |
| Qwen3-4B + NGMModel Scale=4B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 79.25 | |
| Voxtral Small-24B 2507Context Length=128K2026.07 | 74.5 | |
| MiMo-Audio 7BContext Length=8K2026.07 | 73.8 | |
| Audex 2BContext Length=128K2026.07 | 70.2 | |
| Qwen3-1.7B + NGMModel Scale=1.7B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 66.4 | |
| Qwen3-1.7BModel Scale=1.7B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 66.37 | |
| Qwen3-0.6B + NGMModel Scale=0.6B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 46.33 | |
| Qwen3-0.6BModel Scale=0.6B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.05 | 46.12 |