List your company
ResearchFormerly WizWand

Mathematical Reasoning on DART-Math DM-4

40.4Pass@k AccuracyPOLAR
-1.6169.29220.231.108Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
POLARBackbone=LLaMA-3.2-3B-Instruct, k=52026.0640.4
DR.LLMBackbone=LLaMA-3.2-3B-Instruct, k=52026.0633.4
POLARp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0625.4
POLARp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0623.6
DR.LLMp@=22.82026.0622.8
POLARp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0622.4
POLARp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0620.8
DR.LLMp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0618.2
DR.LLMp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0618.2
DR.LLMp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0618.2
POLARp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0618
POLARp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0617.2
POLARp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0617.2
Base (sampling)p@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0615.8
Base (τ=0)p@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0615.2
DR.LLMp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0615.2
Base (sampling)p@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0615.2
Base (sampling)p@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0615
Base (sampling)p@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0614.8
POLARp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0614.8
Base (sampling)p@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0614
Base (sampling)p@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0613.8
Base (sampling)p@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0613.6
POLARp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0612.8
Base (sampling)p@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0612.6
Base (sampling)p@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0612.2
POLARp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.0611.8
ShortGPTp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.0610.2
ShortGPTp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.069.6
ShortGPTp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.068.6
Base (sampling)p@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.068.2
DR.LLMp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.068
Base (τ=0)p@=1, Temperature=0, Backbone=Qwen2.5-3B-Instruct2026.067.8
ShortGPTp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.067.2
DR.LLMp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.067
ShortGPTp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.065.4
DR.LLMp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.065.4
FlexiDepthp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.063.8
DR.LLMp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.063.6
FlexiDepthp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.063.4
FlexiDepthp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.062.8
FlexiDepthp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.062.2
DR.LLMp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.062.2
FlexiDepthp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.061
MindSkipp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.4
MindSkipp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.4
MindSkipp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.4
MindSkipp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.4
MindSkipp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060.4
MindSkipp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
MindSkipp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
FlexiDepthp@=1, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
FlexiDepthp@=2, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
FlexiDepthp@=3, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
FlexiDepthp@=4, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
FlexiDepthp@=5, Backbone=Qwen1.5-MoE-A2.7B-Chat2026.060
ShortGPTp@=1, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=2, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=3, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=4, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060
ShortGPTp@=5, Temperature=sampling, Backbone=Qwen2.5-3B-Instruct2026.060