List your company
ResearchFormerly WizWand

Knowledge on MMLU-Redux

90Knowledge (MMLU-Redux) ScoreQwen3.5-Omni Flash 35B-A3B
44.364856.212468.0679.9076May 16, 2026May 24, 2026Jun 2, 2026Jun 10, 2026Jun 19, 2026Jun 27, 2026Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
Qwen3.5-Omni Flash 35B-A3BContext Length=256K2026.0790
Qwen3-Omni 30B-A3B ThinkingContext Length=64K2026.0788.8
Step-Audio R1.1 33BContext Length=64K2026.0786.6
Audex 30B-A3BContext Length=1M2026.0786.4
Qwen3-14B + NGMModel Scale=14B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.0585.3
Qwen3-14BModel Scale=14B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.0584.88
Qwen3-8B + NGMModel Scale=8B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.0581.26
Qwen3-8BModel Scale=8B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.0580.65
Qwen3-4BModel Scale=4B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.0579.61
Qwen3-4B + NGMModel Scale=4B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.0579.25
Voxtral Small-24B 2507Context Length=128K2026.0774.5
MiMo-Audio 7BContext Length=8K2026.0773.8
Audex 2BContext Length=128K2026.0770.2
Qwen3-1.7B + NGMModel Scale=1.7B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.0566.4
Qwen3-1.7BModel Scale=1.7B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.0566.37
Qwen3-0.6B + NGMModel Scale=0.6B, NGM Configuration=True, Decoding Settings=identical decoding settings, Context Length=40962026.0546.33
Qwen3-0.6BModel Scale=0.6B, NGM Configuration=False, Decoding Settings=identical decoding settings, Context Length=40962026.0546.12