List your company

Mathematical Reasoning on AIME 2024 (test)

96.67AccuracyTeam-of-Thoughts
44.701258.193171.68585.1769Jan 31, 2025Apr 27, 2025Jul 22, 2025Oct 16, 2025Jan 10, 2026Apr 6, 2026Jul 1, 2026

Evaluation results

MethodLinks
Team-of-Thoughtsorchestrator=DeepSeek v3.2, context window=16,384 tokens2026.0296.67———————————————————————————————
Majority Votingcontext window=20,000 tokens2026.0293.33———————————————————————————————
GPT-5 Minicontext window=20,000 tokens2026.0286.67———————————————————————————————
Gemini 3 Flashcontext window=20,000 tokens2026.0286.67———————————————————————————————
DeepSeek v3.2context window=20,000 tokens2026.0286.67———————————————————————————————
Qwen3-vl 235Bcontext window=20,000 tokens2026.0283.33———————————————————————————————
Hard cutoffLimit=10k2026.0582.9————————————————————38.6——————————
Hard cutoffLimit=12k2026.0580.6————————————————————29.9——————————
AgentVersecontext window=20,000 tokens2026.0280———————————————————————————————
DeepSeek r1Model Type=Open Weights, Fine-tuning examples=>800K2025.0179.8———————————————————————————————
Burst-onlytype=completed-trace2026.0577.8————————————————————47.4——————————
Completed hybrid2026.0577.4————————————————————44.8——————————
LessIsMoreToken Budget (K)=6000, Backbone=Qwen3-8B2025.0876.7———15.1———————————————————————————
CATBackbone=Qwen3-8B2026.0776.7—————————————————————————11,7749,86618.418.2——
Claude Sonnet 4.5context window=20,000 tokens2026.0276.67———————————————————————————————
OPSDModel Scale=Qwen3-4B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=162026.0676———————————————————————————————
LessIsMoreToken Budget (K)=4000, Backbone=Qwen3-8B2025.0875.8———14.8———————————————————————————
RA-RFTModel Scale=Qwen3-4B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0675.8———————————————————————————————
DASTBackbone=Qwen3-8B2026.0775.6—————————————————————————13,43310,252715——
GRPOModel Scale=Qwen3-4B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0674.8———————————————————————————————
Full AttentionToken Budget (K)=2000, Backbone=Qwen3-8B2025.0874.5———14.8———————————————————————————
Full AttentionToken Budget (K)=4000, Backbone=Qwen3-8B2025.0874.5———14.8———————————————————————————
Full AttentionToken Budget (K)=6000, Backbone=Qwen3-8B2025.0874.5———14.8———————————————————————————
o1Model Type=API only, Fine-tuning examples=N.A.2025.0174.4———————————————————————————————
Qwen3-8BBackbone=Qwen3-8B2026.0774.4—————————————————————————14,43712,060————
ConCISESimPOBackbone=Qwen3-8B2026.0774.4—————————————————————————10,1907,96129.434——
SeerAttention-rToken Budget (K)=6000, Backbone=Qwen3-8B2025.0874.1———15.3———————————————————————————
AsyncNPUs=48, GBS=32, MBS=12025.1173.8—————————————123.99933.449————————————————
LessIsMoreToken Budget (K)=2000, Backbone=Qwen3-8B2025.0873.8———15.8———————————————————————————
OverThinkSimPOBackbone=Qwen3-8B2026.0773.3—————————————————————————10,5457,9602734——
No filter2026.0573.2————————————————————0——————————
r1-distillModel Type=Open Weights, Fine-tuning examples=800K2025.0172.6———————————————————————————————
SyncNPUs=48, GBS=32, MBS=12025.1172.5—————————————123.61326.219————————————————
Hard cutoffLimit=8k2026.0571.9————————————————————49.9——————————
MindSpeed-RLNPUs=64, GBS=32, MBS=12025.1171.7—————————————107.8746.627————————————————
SeerAttention-rToken Budget (K)=4000, Backbone=Qwen3-8B2025.0871.4———16.3———————————————————————————
TidalDecodeToken Budget (K)=6000, Backbone=Qwen3-8B2025.0871.3———15.9———————————————————————————
CoDiQ-L3-4BParameters=4B, Curriculum Stage=L32026.0270.6———————————————————————————————
Base (Instruct)Model Scale=Qwen3-4B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0670.5———————————————————————————————
o1-miniModel Type=API only, Fine-tuning examples=N.A.2025.0170———————————————————————————————
SyncNPUs=64, GBS=64, MBS=12025.1170—————————————185.79646.519————————————————
TidalDecodeToken Budget (K)=4000, Backbone=Qwen3-8B2025.0870———16.9———————————————————————————
Base model (32B)2025.1169.6———————————————————————————————
AsyncNPUs=64, GBS=64, MBS=12025.1167.5—————————————188.08177.342————————————————
CoDiQ-L2-4BParameters=4B, Curriculum Stage=L22026.0266.7———————————————————————————————
A3POModel=Deepseek-R1-Distill-Qwen-7B2025.1265.2———————————————————————————————
CoDiQ-L1-4BParameters=4B, Curriculum Stage=L12026.0265———————————————————————————————
Qwen3-RL-4BParameters=4B, Type=Baseline, Training=Reinforcement Learning2026.0264.3———————————————————————————————
DeepSeek-R1-Distill-Qwen-32BNumber of Parameters=32B, Prompting Strategy=reproduced using our prompt2025.0363.3———————————————————————————————
Bespoke-32BModel Type=Open Weights and Open Data, Fine-tuning examples=17K2025.0163.3———————————————————————————————
Qwen3-4BParameters=4B, Type=Baseline2026.0263.1———————————————————————————————
Lp-RegModel=Deepseek-R1-Distill-Qwen-7B2025.1261.9———————————————————————————————
VERL (async)NPUs=64, GBS=64, MBS=642025.1161.7—————————————157.76544.016————————————————
W-REINFORCEModel=Deepseek-R1-Distill-Qwen-7B2025.1261.6———————————————————————————————
DAPO w/ Fork TokensModel=Deepseek-R1-Distill-Qwen-7B2025.1261.2———————————————————————————————
DAPOModel=Deepseek-R1-Distill-Qwen-7B2025.1260.8———————————————————————————————
PROMPTCOT-DS-7BBase Model=DeepSeek-R1-Distill-Qwen-7B, Reasoning Strategy=long-CoT, Parameters=7B2025.0360———————————————————————————————
PROMPTCOT-DS-7BNumber of Parameters=7B2025.0360———————————————————————————————
Gemini 2.0 Flash ThinkingModel Type=API only, Fine-tuning examples=N.A.2025.0160———————————————————————————————
GPT-OSS 20Bcontext window=20,000 tokens2026.0260———————————————————————————————
GRPOModel=Deepseek-R1-Distill-Qwen-7B2025.1259.4———————————————————————————————
CATBackbone=DeepSeek-R1-Distill-Qwen-7B2026.0758.9—————————————————————————9,8805,4012329.2——
SeerAttention-rToken Budget (K)=2000, Backbone=Qwen3-8B2025.0858.2———19.8———————————————————————————
S1-32BNumber of Parameters=32B2025.0356.7———————————————————————————————
s1-32BModel Type=Open Weights and Open Data, Fine-tuning examples=1K, Budget Forcing=true2025.0156.7———————————————————————————————
DASTBackbone=DeepSeek-R1-Distill-Qwen-7B2026.0756.7—————————————————————————10,8047,15815.86.2——
RA-RFTModel Scale=Qwen3-1.7B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0655.1———————————————————————————————
SPIRALFamily=DeepSeek-Distill-Qwen-7B Family, Game=Multi-Game2025.0654.1———————————————————————————————
JETBackbone=DeepSeek-Distill-Qwen-7B2025.0954———7,981———————————————————————————
MURBackbone=Qwen3-30B-A3B, Search Strategy=Guided search2025.0753.33—————————————————27,788—————————————
DAPOBackbone=DeepSeek-Distill-Qwen-7B2025.0953.3———8,414———————————————————————————
TidalDecodeToken Budget (K)=2000, Backbone=Qwen3-8B2025.0853.3———17.4———————————————————————————
R1-7BBackbone=DeepSeek-R1-Distill-Qwen-7B2026.0753.3—————————————————————————12,8317,631————
DeepSeek-Distill-Qwen-7BFamily=DeepSeek-Distill-Qwen-7B Family2025.0653———————————————————————————————
DPOBackbone=DeepSeek-Distill-Qwen-7B2025.0953———9,552———————————————————————————
Laser-DEBackbone=DeepSeek-Distill-Qwen-7B2025.0953———5,809———————————————————————————
Laser-DBackbone=DeepSeek-Distill-Qwen-7B2025.0952.7———6,361———————————————————————————
InftyThink+Base Model=Qwen3-4B-Base, RL Setting=Task reward only2026.0252.29—21.44319.15————————————————————————————
OverThinkSimPOBackbone=DeepSeek-R1-Distill-Qwen-7B2026.0752.2—————————————————————————10,0305,84521.823.4——
QuestAModel Scale=Qwen3-1.7B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0652———————————————————————————————
RoT+TIModel=DLER-7B2025.0951.85———————————————2,008.33———————————————
RoTModel=DeepSeek-R1-Llama8B2025.0951.85———————————————9,397.11———————————————
OPSDModel Scale=Qwen3-1.7B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=162026.0651.4———————————————————————————————
BaseBackbone=DeepSeek-Distill-Qwen-7B2025.0951.3———9,812———————————————————————————
InftyThink+Base Model=DeepSeek-R1-Distill-Qwen-1.5B, RL Setting=Task reward only2026.0250.94—23.36102.85————————————————————————————
AdaThinkBackbone=DeepSeek-Distill-Qwen-7B2025.0950.7———8,131———————————————————————————
GRPOModel Scale=Qwen3-1.7B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0650.4———————————————————————————————
VanillaBase Model=Qwen3-4B-Base, RL Setting=Task reward only2026.0250.31—17.16571.18————————————————————————————
QwQ-32BNumber of Parameters=32B2025.0350———————————————————————————————
QwQ-32BModel Type=Open Weights, Fine-tuning examples=N.A.2025.0150———————————————————————————————
s1 w/o BFModel Type=Open Weights and Open Data, Fine-tuning examples=1K, Budget Forcing=false2025.0150———————————————————————————————
LCR1Backbone=DeepSeek-Distill-Qwen-7B2025.0950———6,329———————————————————————————
QuestToken Budget (K)=6000, Backbone=Qwen3-8B2025.0849.6———19.6———————————————————————————
InftyThink+Base Model=Qwen3-4B-Base, RL Setting=Task + efficiency reward used2026.0249.06—13.46185.79————————————————————————————
ConCISESimPOBackbone=DeepSeek-R1-Distill-Qwen-7B2026.0748.9—————————————————————————8,8545,3333130.1——
SFTBackbone=DeepSeek-Distill-Qwen-7B2025.0948.7———9,814———————————————————————————
Base (Instruct)Model Scale=Qwen3-1.7B, Temperature=1.0, Maximum generation length=32,768, Sample count (k)=322026.0648.1———————————————————————————————
FullKVBackbone=DeepSeek-R1-Distill-Qwen-7B, KV budget=100%2026.0446.7———————————————————————————————
TriAttentionBackbone=DeepSeek-R1-Distill-Qwen-7B, KV budget=30%2026.0446.7———————————————————————————————
QuestToken Budget (K)=4000, Backbone=Qwen3-8B2025.0846.7———22.9———————————————————————————