List your company
ResearchFormerly WizWand

Reasoning on BigBenchHard

100Accuracy (BigBenchHard)Ll4-Sct
29.07247.48665.984.314Jul 6, 2025Aug 29, 2025Oct 22, 2025Dec 15, 2025Feb 7, 2026Apr 2, 2026May 26, 2026
Updated 3mo ago

Evaluation results

MethodLinks
Ll4-Sct2026.05100
Gm2.5fl2026.0599.19
Gemma 3 27BParameters=27B2026.0282.4
General-Reasoner-14BModel Category=Frontier Models2026.0478.2
TTRLBase Model=Qwen3-8B-Base2026.0474.9
TEMPOBase Model=Qwen3-8B-Base2026.0474.2
DictaLM 3.0 24B-ThinkParameters=24B, Variant=Thinking2026.0273
Mistral Small 3.12026.0271.91
DictaLM 3.0 12B-InstParameters=12B, Variant=Instruct2026.0271.38
Gemma 3 12BParameters=12B2026.0270.1
Zero-RL (PPO)Base Model=Qwen3-8B-Base2026.0469.9
CT-KVPretrained Model=Qwen3-32B2025.0769.1
TEMPOBase Model=OLMO3-7B-Base2026.0468.2
EMPOBase Model=Qwen3-8B-Base2026.0466.7
CT-KVPretrained Model=DeepSeek-32B2025.0766.7
General-Reasoner-7BModel Category=Frontier Models2026.0465.6
CT-KVPretrained Model=Qwen3-14B2025.0764.2
ICLPretrained Model=DeepSeek-32B2025.0763.5
ICLPretrained Model=Qwen3-32B2025.0763.1
MiMo-Zero-RL-7BModel Category=Frontier Models2026.0461.4
ICLPretrained Model=Qwen3-14B2025.0760.8
CT-KVPretrained Model=DeepSeek-14B2025.0758.4
CT-KVPretrained Model=Mistral-12B2025.0757.4
Olmo-3-7B-RL-Zero-GeneralModel Category=Frontier Models2026.0456.5
Prefix TuningPretrained Model=Qwen3-32B, m=322025.0756.4
ICLPretrained Model=DeepSeek-14B2025.0755.2
Prefix TuningPretrained Model=DeepSeek-32B, m=322025.0753
EMPOBase Model=OLMO3-7B-Base2026.0452.9
ICLPretrained Model=Mistral-12B2025.0751.3
Prefix TuningPretrained Model=DeepSeek-14B, m=322025.0749.8
Prefix TuningPretrained Model=Qwen3-14B, m=322025.0749.3
Zero-RL (PPO)Base Model=OLMO3-7B-Base2026.0446.8
TTRLBase Model=OLMO3-7B-Base2026.0445.4
MobileMoE-LActive Parameters=922M, Total Parameters=5.3B, Few-shot count=3-shot2026.0537.8
MobileMoE-MActive Parameters=528M, Total Parameters=2.8B, Few-shot count=3-shot2026.0537.7
Prefix TuningPretrained Model=Mistral-12B, m=322025.0737
MobileMoE-SActive Parameters=272M, Total Parameters=1.3B, Few-shot count=3-shot2026.0531.8