List your company

Mathematical Reasoning on MATH (Exact Match, Avg, ΔScore)

87Exact Match AccuracyWORC+AC
19.436.9554.572.05Mar 13, 2026Mar 26, 2026Apr 8, 2026Apr 21, 2026May 4, 2026May 17, 2026May 30, 2026

Evaluation results

MethodLinks
WORC+AC2026.0487——
AoT2026.0483.6——
AFlow2026.0483——
FoTn (sampling size)=82026.0482.5——
CoT-SCn (sampling size)=52026.0481.8——
AgentChain2026.0481——
Self-Refine2026.0478.7——
CoT2026.0478.3——
High Prediction Entropy-onlyBackbone=Qwen3-8B-Base2026.0574.41——
Entropy reweightingBackbone=Qwen3-8B-Base, Layer=Mid (Layer 20)2026.0574.15——
Entropy reweightingBackbone=Qwen3-8B-Base, Layer=Shallow (Layer 8)2026.0573.88——
Entropy reweightingBackbone=Qwen3-8B-Base, Layer=Deep (Layer 31)2026.0573.54——
Full-token DAPOBackbone=Qwen3-8B-Base2026.0571.8——
Explorer-only, successful seeds (diagnostic)Backbone=Qwen3-8B-Base2026.0570.98——
Random-20%Backbone=Qwen3-8B-Base2026.0570.91——
DASDBase Model=Qwen3-4B2026.0570.274.3—
Mask-PPLBase Model=Qwen3-4B2026.0569.271.1—
Hint-decodingBase Model=Qwen3-4B2026.0568.471.6—
Self-DistillationBase Model=Qwen3-4B2026.056769.7—
Anchor-onlyBackbone=Qwen3-8B-Base2026.0566.43——
Analogical Prompting2026.0465.4——
OriginBase Model=Qwen3-4B2026.056370.8—
MemRewardBackbone=Qwen2.5-3B-Instruct, Supervision Paradigm=20% GT + GNN2026.0361.1177.02-2.1
R1-OracleBackbone=Qwen2.5-3B-Instruct, Supervision Paradigm=100% GT2026.0360.3379.120
R1-pBackbone=Qwen2.5-3B-Instruct, Supervision Paradigm=20% GT2026.0354.6775.67-3.45
R1-OracleBackbone=Qwen2.5-1.5B-Instruct, Supervision Paradigm=100% GT2026.0353.1170.470
MemRewardBackbone=Qwen2.5-1.5B-Instruct, Supervision Paradigm=20% GT + GNN2026.0350.8968.1-2.37
Explorer-only, all seedsBackbone=Qwen3-8B-Base2026.0546.79——
R1-pBackbone=Qwen2.5-1.5B-Instruct, Supervision Paradigm=20% GT2026.0344.4462.72-7.75
Hint-decodingBase Model=Llama3.2-3B2026.0541.856.3—
DASDBase Model=Llama3.2-3B2026.0541.656.7—
Mask-PPLBase Model=Llama3.2-3B2026.0538.854.7—
Self-DistillationBase Model=Llama3.2-3B2026.0538.453.1—
OriginBase Model=Llama3.2-3B2026.053652.3—
DASDBase Model=Gemma2-2B2026.0527.447—
Hint-decodingBase Model=Gemma2-2B2026.0526.245.9—
Self-DistillationBase Model=Gemma2-2B2026.0524.844.8—
Mask-PPLBase Model=Gemma2-2B2026.0524.845.4—
OriginBase Model=Gemma2-2B2026.052243—