List your company
ResearchFormerly WizWand

Mathematical Reasoning on AIME 2025 (Accuracy, Tokens)

59.2AccuracyMERA
18.6429.1739.750.23Aug 6, 2025
Updated 4mo ago

Evaluation results

MethodLinks
MERABackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0859.27,320
OriginalBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0856.412,752
DASTBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0856.210,298
FCS+Ref.Backbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0853.78,309
MERABackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0853.68,732
O1-PrunerBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0853.19,356
LCPOBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0850.210,405
FCS+Ref.Backbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0849.89,844
DASTBackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0849.59,721
O1-PrunerBackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0849.410,973
OriginalBackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0848.213,276
DEERBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0847.39,723
No WaitBackbone=DeepSeek-R1-Distill-Qwen-14B, Zero-shot Chain-of-Thought (CoT)=true2025.0845.38,280
LCPOBackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0840.69,904
DEERBackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0839.69,302
No WaitBackbone=DeepSeek-R1-Distill-Qwen-7B, Zero-shot Chain-of-Thought (CoT)=true2025.0835.211,827
MERABackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0830.99,357
FCS+Ref.Backbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0828.611,624
OriginalBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0826.914,680
LCPOBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0824.710,075
O1-PrunerBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0824.112,701
DASTBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0820.610,647
No WaitBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0820.311,601
DEERBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Zero-shot Chain-of-Thought (CoT)=true2025.0820.29,890