List your company

Mathematical Reasoning on AIME 25 (Acc, Tok, CR)

92.6AccuracyVanilla
-3.49621.45246.471.348Mar 13, 2026Mar 25, 2026Apr 7, 2026Apr 20, 2026May 3, 2026May 16, 2026May 29, 2026

Evaluation results

MethodLinks
VanillaBackbone=Ministral-3-8B-Reasoning-25122026.0392.622,124100—
VanillaBackbone=Ministral-3-14B-Reasoning-25122026.0388.123,694100—
DynasorBackbone=Ministral-3-8B-Reasoning-25122026.0387.615,40766.3—
Thought-CalibBackbone=Ministral-3-8B-Reasoning-25122026.0383.720,35891.2—
DynasorBackbone=Ministral-3-14B-Reasoning-25122026.0383.217,92070.6—
VanillaBackbone=Qwen3-14B2026.0379.914,255100—
VanillaBackbone=Qwen3-8B2026.0374.414,499100—
TERMINATORBackbone=Qwen3-14B2026.0374.210,78771—
TERMINATORBackbone=Qwen3-8B2026.0369.410,97070.7—
DEERBackbone=Ministral-3-8B-Reasoning-25122026.0367.117,48177—
Thought-CalibBackbone=Qwen3-8B2026.0365.811,01481.5—
TERMINATORBackbone=Ministral-3-14B-Reasoning-25122026.0365.815,89868.7—
Thought-CalibBackbone=Qwen3-14B2026.0363.39,42971.3—
DynasorBackbone=Qwen3-14B2026.0361.87,93752.8—
Thought-CalibBackbone=Ministral-3-14B-Reasoning-25122026.0359.417,76379.8—
TERMINATORBackbone=Ministral-3-8B-Reasoning-25122026.0357.415,23967.1—
DEERBackbone=Ministral-3-14B-Reasoning-25122026.0355.920,04984.9—
DynasorBackbone=Qwen3-8B2026.03487,47948.8—
NoThinkingBackbone=Ministral-3-8B-Reasoning-25122026.0343.67,71136.5—
Qwen3-14B + GRPOBackbone=Qwen3-14B, Training=GRPO2026.0533.1——6,638
Qwen3-14B + SLATBackbone=Qwen3-14B, Training=SLAT2026.0531.6——4,477
DEERBackbone=Qwen3-14B2026.0327.610,49771—
NoThinkingBackbone=Qwen3-14B2026.0326.32,47219.9—
Qwen2.5-7B-Math + SFT + RL-TCERBase Model=Qwen2.5-7B-Math, Training Strategy=SFT + RL-TCER2026.0426.1———
Qwen2.5-7B-Math + SFT + RL-EndoRBase Model=Qwen2.5-7B-Math, Training Strategy=SFT + RL-EndoR2026.0425.4———
DyJR (M = 16)Backbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, M=162026.0323.6———
DyJRBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, alpha_JS=0.05, M=82026.0323.1———
RLEPBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@2562026.0323———
DPH-RLBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@2562026.0322.8———
DyJR (Forward KL)Backbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, Divergence Type=Forward KL2026.0322.8———
DyJR (alpha_JS = 0.01)Backbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, alpha_JS=0.012026.0322.5———
Qwen2.5-7B-Math + SFTBase Model=Qwen2.5-7B-Math, Training Strategy=SFT2026.0422.3———
NoThinkingBackbone=Qwen3-8B2026.03222,35518.6—
DyJR (M = 32)Backbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, M=322026.0322———
Ex-GRPOBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@2562026.0321.7———
DAPOBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@2562026.0321.5———
DEERBackbone=Qwen3-8B2026.0321.410,34967.8—
DyJR (alpha_JS = 0.2)Backbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, alpha_JS=0.22026.0321.4———
DyJR (M = 64)Backbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@256, M=642026.0321.3———
NoThinkingBackbone=Ministral-3-14B-Reasoning-25122026.0320.52,41313.8—
GRPOBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@2562026.0319.1———
Llama3.1-8B-Instruct + SFT + RL-TCERBase Model=Llama3.1-8B-Instruct, Training Strategy=SFT + RL-TCER2026.0415———
Llama3.1-8B-Instruct + SFT + RL-EndoRBase Model=Llama3.1-8B-Instruct, Training Strategy=SFT + RL-EndoR2026.0413.2———
Llama3.1-8B-Instruct + SFTBase Model=Llama3.1-8B-Instruct, Training Strategy=SFT2026.049.5———
Base ModelBackbone=Qwen3-4B-Base, Evaluation Protocol (Mean@k)=Mean@2562026.038.2———
Qwen3-14BBackbone=Qwen3-14B2026.057.5——1,835
Qwen2.5-7B-MathBase Model=Qwen2.5-7B-Math, Training Strategy=None2026.044.4———
Llama3.1-8B-InstructBase Model=Llama3.1-8B-Instruct, Training Strategy=None2026.040.2———
AdaCoTModel Scale=1.5B, Base Model=Qwen2.5-Math2026.06—6,271——
AdaCoTModel Scale=7B, Base Model=Qwen2.5-Math2026.06—7,648——
AdaptThinkModel Scale=1.5B, Base Model=Qwen2.5-Math2026.06—6,513——
AdaptThinkModel Scale=7B, Base Model=Qwen2.5-Math2026.06—7,842——
DeepSeek-R1-DistillModel Scale=1.5B, Base Model=Qwen2.5-Math2026.06—11,239——
DeepSeek-R1-DistillModel Scale=7B, Base Model=Qwen2.5-Math2026.06—10,833——
LHRMsModel Scale=1.5B, Base Model=Qwen2.5-Math2026.06—3,257——
LHRMsModel Scale=7B, Base Model=Qwen2.5-Math2026.06—4,217——
S-GRPOModel Scale=1.5B, Base Model=Qwen2.5-Math2026.06—6,640——
S-GRPOModel Scale=7B, Base Model=Qwen2.5-Math2026.06—5,259——
SuCoModel Scale=1.5B, Base Model=Qwen2.5-Math2026.06—3,484——
SuCoModel Scale=7B, Base Model=Qwen2.5-Math2026.06—2,679——