List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (Original, Emotional, Neutralized Accuracy)

98Original AccuracyGPT-4o
31.4448.726683.28Apr 9, 2026
Updated 6mo ago

Evaluation results

MethodLinks
GPT-4oModel Tier=Frontier, Prompting Strategy=Base, Decoding=Greedy2026.04989595.3
GPT-4oModel Tier=Frontier, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0497.895.295.2
Llama-3.3-70BModel Tier=Medium, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0497.593.294.7
GPT-5Model Tier=Frontier, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0497.594.594.9
GPT-5.4Model Tier=Frontier, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0497.59695.7
o3Model Tier=Frontier, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0497.594.695.2
GPT-5.4Model Tier=Frontier, Prompting Strategy=Base, Decoding=Greedy2026.049795.895.8
o3Model Tier=Frontier, Prompting Strategy=Base, Decoding=Greedy2026.049794.495.7
Llama-3.3-70BModel Tier=Medium, Prompting Strategy=Base, Decoding=Greedy2026.0496.893.794.6
Qwen-2.5-72BModel Tier=Medium, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0496.893.994.3
GPT-5Model Tier=Frontier, Prompting Strategy=Base, Decoding=Greedy2026.0496.594.995.2
Frontier avgPrompting Strategy=Base2026.0496.594.295
Frontier avgPrompting Strategy=Zero-shot CoT2026.0496.49494.5
DeepSeek-V3Model Tier=Frontier, Prompting Strategy=Base, Decoding=Greedy2026.0495.894.194.5
DeepSeek-V3Model Tier=Frontier, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0495.893.793.9
Mistral-Sm-24BModel Tier=Medium, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0495.591.793.1
Qwen-2.5-72BModel Tier=Medium, Prompting Strategy=Base, Decoding=Greedy2026.0495.293.794.4
Mistral-Sm-24BModel Tier=Medium, Prompting Strategy=Base, Decoding=Greedy2026.049591.893.8
GPT-4o-miniModel Tier=Frontier, Prompting Strategy=Base, Decoding=Greedy2026.0494.890.993.3
Qwen-2.5-7BModel Tier=Small, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0492.88889.7
GPT-4o-miniModel Tier=Frontier, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0492.590.292.3
Gemma-2-27BModel Tier=Medium, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.049289.290.5
Gemma-2-27BModel Tier=Medium, Prompting Strategy=Base, Decoding=Greedy2026.0491.887.890.6
Gemma-2-9BModel Tier=Small, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0488.885.488.5
Gemma-2-9BModel Tier=Small, Prompting Strategy=Base, Decoding=Greedy2026.048783.886.5
Qwen-2.5-3BModel Tier=Tiny, Prompting Strategy=Base, Decoding=Greedy2026.0486.279.183.9
Qwen-2.5-3BModel Tier=Tiny, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.048681.185
Llama-3.1-8BModel Tier=Small, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.048680.984.4
Llama-3.1-8BModel Tier=Small, Prompting Strategy=Base, Decoding=Greedy2026.048478.582.6
Open-src avgPrompting Strategy=Zero-shot CoT2026.0480.976.779.6
Qwen-2.5-7BModel Tier=Small, Prompting Strategy=Base, Decoding=Greedy2026.0480.273.778.8
Open-src avgPrompting Strategy=Base2026.0478.673.577.4
Llama-3.2-3BModel Tier=Tiny, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0476.267.674.2
Llama-3.2-3BModel Tier=Tiny, Prompting Strategy=Base, Decoding=Greedy2026.0474.564.571.5
Gemma-2-2BModel Tier=Tiny, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.046459.262.5
Mistral-7BModel Tier=Small, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.0461.25758.7
Gemma-2-2BModel Tier=Tiny, Prompting Strategy=Base, Decoding=Greedy2026.0460.856.961.7
Mistral-7BModel Tier=Small, Prompting Strategy=Base, Decoding=Greedy2026.045649.553.8
Llama-3.2-1BModel Tier=Tiny, Prompting Strategy=Base, Decoding=Greedy2026.0435.22936.8
Llama-3.2-1BModel Tier=Tiny, Prompting Strategy=Zero-shot CoT, Decoding=Greedy2026.043433.439.7