List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (Inference Runtime)

0Total Inference Time (mm:ss)DAST
-0.321.8446.16Apr 3, 2026
Updated 7mo ago

Evaluation results

MethodLinks
DASTModel=DeepSeek-R1-Qwen-32B2026.040
REDModel=DeepSeek-R1-Qwen-32B2026.040
REDModel=Qwen3-8B-Thinking2026.041
DASTModel=DeepSeek-R1-Qwen-7B2026.041
RL +length penaltyModel=DeepSeek-R1-Qwen-7B2026.041
S-GRPOModel=DeepSeek-R1-Qwen-7B2026.041
REDModel=DeepSeek-R1-Qwen-7B2026.041
VanillaModel=DeepSeek-R1-Qwen-32B2026.041
Think or NotModel=DeepSeek-R1-Qwen-32B2026.041
RL +length penaltyModel=DeepSeek-R1-Qwen-32B2026.041
S-GRPOModel=DeepSeek-R1-Qwen-32B2026.041
DASTModel=Qwen3-8B-Thinking2026.042
REDModel=Qwen3-32B-Thinking2026.042
VanillaModel=DeepSeek-R1-Qwen-7B2026.042
Think or NotModel=DeepSeek-R1-Qwen-7B2026.042
VanillaModel=DeepSeek-R1-Llama-8B2026.042
Think or NotModel=DeepSeek-R1-Llama-8B2026.042
DASTModel=DeepSeek-R1-Llama-8B2026.042
RL +length penaltyModel=DeepSeek-R1-Llama-8B2026.042
S-GRPOModel=DeepSeek-R1-Llama-8B2026.042
REDModel=DeepSeek-R1-Llama-8B2026.042
DASTModel=DeepSeek-R1-Llama-70B2026.042
RL +length penaltyModel=DeepSeek-R1-Llama-70B2026.042
S-GRPOModel=DeepSeek-R1-Llama-70B2026.042
REDModel=DeepSeek-R1-Llama-70B2026.042
RL +length penaltyModel=Qwen3-8B-Thinking2026.043
S-GRPOModel=Qwen3-8B-Thinking2026.043
VanillaModel=DeepSeek-R1-Llama-70B2026.043
Think or NotModel=DeepSeek-R1-Llama-70B2026.043
Think or NotModel=Qwen3-8B-Thinking2026.044
DASTModel=Qwen3-32B-Thinking2026.044
VanillaModel=Qwen3-8B-Thinking2026.045
Think or NotModel=Qwen3-32B-Thinking2026.046
RL +length penaltyModel=Qwen3-32B-Thinking2026.046
S-GRPOModel=Qwen3-32B-Thinking2026.046
VanillaModel=Qwen3-32B-Thinking2026.048