List your company
ResearchFormerly WizWand

Mathematical Reasoning on DART-Math DM-2

48Pass@k AccuracyPOLAR
-1.9211.042436.96Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
POLARBackbone=LLaMA-3.2-3B-Instruct, k=52026.0648
POLARp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0644
POLARp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0641.2
POLARp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0640.6
POLARp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0639
DR.LLMp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0636.8
POLARp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0634.6
POLARp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0634.6
POLARp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0631.4
DR.LLMp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0630.4
DR.LLMp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0630.2
Base (sampling)p@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0630.2
DR.LLMp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0629.8
Base (sampling)p@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0629.2
Base (tau=0)Backbone=LLaMA-3.2-3B-Instruct, k=12026.0628.6
POLARp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0628
Base (sampling)p@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0626.8
POLARp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0626.2
Base (sampling)p@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0625.6
Base (sampling)p@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0625
Base (τ=0)p@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0624.6
Base (sampling)p@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0624.6
DR.LLMp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0624.6
POLARp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0624.4
Base (sampling)p@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0624.2
FlexiDepthp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0624
Base (sampling)p@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0622.8
FlexiDepthp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0622.4
Base (sampling)p@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0622
FlexiDepthp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0620
ShortGPTp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0618.6
ShortGPTp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0617.6
ShortGPTp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0616.6
Base (sampling)p@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0616
ShortGPTp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0615
FlexiDepthp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0615
DR.LLMp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0614.6
Base (τ=0)p@=1, Temperature=0, Backbone=Qwen2.5-3B-Instruct2026.0613.6
DR.LLMp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0613
ShortGPTp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0612.2
DR.LLMp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0611.8
DR.LLMp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.069.8
FlexiDepthp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.068.8
DR.LLMp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.066.6
MindSkipp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.061.4
FlexiDepthp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.061
MindSkipp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.061
FlexiDepthp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060.8
FlexiDepthp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060.8
MindSkipp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.8
MindSkipp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.6
FlexiDepthp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060.4
MindSkipp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.4
MindSkipp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
FlexiDepthp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
ShortGPTp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060