List your company
ResearchFormerly WizWand

General Knowledge Question Answering on MMLU-PRO

81.61AccuracySMCS
39.07450.11761.1672.203Jul 14, 2025Sep 4, 2025Oct 26, 2025Dec 18, 2025Feb 8, 2026Apr 1, 2026May 24, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SMCSMaximum output tokens=32,7682025.0781.61
GPT-4.1(2025-04-14)Maximum output tokens=32,7682025.0780.43
Claude-3.5-Sonnet(2024-06-20)Maximum output tokens=32,7682025.0778.34
QwQ-32BMaximum output tokens=32,7682025.0778.34
GLM-Z1-32B-0414Maximum output tokens=32,7682025.0777.84
Qwen3-32BMaximum output tokens=32,7682025.0777.76
DeepSeek-R1-Distill-Llama-70BMaximum output tokens=32,7682025.0776.09
DeepSeek-R1-Distill-Qwen-32BMaximum output tokens=32,7682025.0775.17
HuatuoGPT-o1-72BMaximum output tokens=32,7682025.0774.16
GPT-o3-mini(2025-01-31)Maximum output tokens=32,7682025.0774
GPT-4o(2024-08-06)Maximum output tokens=32,7682025.0773.83
Qwen-2.5-72B-InstructMaximum output tokens=32,7682025.0772.16
EXAONE-Deep-32BMaximum output tokens=32,7682025.0770.48
Llama-3.3-70B-InstructMaximum output tokens=32,7682025.0769.87
Claude-3.7-Sonnet(2025-02-19)Maximum output tokens=32,7682025.0769.43
Qwen2.5-32b-InstructMaximum output tokens=32,7682025.0769.15
TeleChat2-35B-32KMaximum output tokens=32,7682025.0767.98
Llama-3.3-Nemotron-Super-49B-v1Maximum output tokens=32,7682025.0767.47
Gemma-3-27b-itMaximum output tokens=32,7682025.0765.47
Qwen2.5-Coder-32B-InstructMaximum output tokens=32,7682025.0761.79
DarkForestModels=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0558.38
DebateModels=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0555.86
Mixture-of-AgentModels=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0553.38
Self-ConsistencyModels=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0553
RefineModels=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0552.62
ReConcileModels=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0545.71
InternLM2.5-20B-ChatMaximum output tokens=32,7682025.0744.23
Graph-of-Agent (Max)Models=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0541.86
Graph-of-Agent (Mean)Models=Qwen2.5-7B-Instruct, Qwen2.5-Coder-7B-Instruct, Mathstral-7B-v0.12026.0540.71