List your company
ResearchFormerly WizWand

Multilingual Knowledge on MMMLU

87.2AccuracyGLM 4.6
28.585643.802859.0274.2372Nov 28, 2025Dec 3, 2025Dec 8, 2025Dec 14, 2025Dec 19, 2025Dec 24, 2025Dec 30, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GLM 4.6Evaluation Mode=Chat2025.1287.2
DeepSeek V3.2Evaluation Mode=Chat2025.1286.7
LongCat-Flash Exp-ChatEvaluation Mode=Chat2025.1285.2
LongCat-Flash ChatEvaluation Mode=Chat2025.1281.7
Qwen3-4BTotal Parameters=4B, Active Parameters=4B, Trained Tokens=36T2025.1160.67
Granite-4.0-HTotal Parameters=7B, Active Parameters=1B, Trained Tokens=15T2025.1156.13
LFM2-2.6BTotal Parameters=2.6B, Active Parameters=2.6B, Trained Tokens=11T2025.1155.39
LFM2-8B-A1BTotal Parameters=8.3B, Active Parameters=1.5B, Trained Tokens=13T2025.1155.26
Gemma-3-4BTotal Parameters=4B, Active Parameters=4B, Trained Tokens=4T2025.1150.14
SmolLM3-3BTotal Parameters=3.1B, Active Parameters=3.1B, Trained Tokens=11T2025.1150.02
Llama-3.2-3BTotal Parameters=3.2B, Active Parameters=3.2B, Trained Tokens=9T2025.1147.92
LFM2-1.2B# Total Params=1.2B, # Trained Tokens=11T2025.1146.73
Qwen3-1.7B# Total Params=1.7B, # Trained Tokens=36T2025.1146.51
LFM2-700M# Total Params=0.70B, # Trained Tokens=11T2025.1143.28
Llama-3.2-1B# Total Params=1.2B, # Trained Tokens=9T2025.1138.15
LFM2-350M# Total Params=0.35B, # Trained Tokens=11T2025.1137.99
Gemma-3-1B# Total Params=1B, # Trained Tokens=2T2025.1134.43
Qwen3-0.6B# Total Params=0.6B, # Trained Tokens=36T2025.1130.84