List your company

Mathematical Reasoning on AIME24 (Accuracy, Tokens, Token Reduction %)

86AccuracyParallel Thinking
41.59253.12164.6576.179Jun 30, 2026

Evaluation results

MethodLinks
Parallel ThinkingModel=DeepSeek-8B, Decoding Strategy=Parallel Thinking, Branching factor (n)=32, Aggregation Strategy=majority voting2026.068622.6—
Fork-thinkModel=DeepSeek-8B, Decoding Strategy=Fork-think, Branching factor (n)=32, Aggregation Strategy=majority voting, Seed path length (l0)=2,0482026.068620.3-10
Fork-thinkModel=Qwen3-8B, Decoding Strategy=Fork-think, Branching factor (n)=32, Aggregation Strategy=majority voting, Seed path length (l0)=2,0482026.0681.814.2-30
Parallel ThinkingModel=Qwen3-8B, Decoding Strategy=Parallel Thinking, Branching factor (n)=32, Aggregation Strategy=majority voting2026.0680.120.2—
GreedyModel=DeepSeek-8B, Decoding Strategy=Greedy, Aggregation Strategy=majority voting2026.06800.68—
CoTModel=DeepSeek-8B, Decoding Strategy=CoT, Aggregation Strategy=majority voting2026.06800.7—
Parallel ThinkingModel=Phi-4-RP-14B, Decoding Strategy=Parallel Thinking, Branching factor (n)=32, Aggregation Strategy=majority voting2026.0677.812.2—
Fork-thinkModel=Phi-4-RP-14B, Decoding Strategy=Fork-think, Branching factor (n)=32, Aggregation Strategy=majority voting, Seed path length (l0)=2,0482026.067711.2-8
CoTModel=Qwen3-8B, Decoding Strategy=CoT, Aggregation Strategy=majority voting2026.0668.70.6—
CoTModel=Phi-4-RP-14B, Decoding Strategy=CoT, Aggregation Strategy=majority voting2026.0667.30.4—
GreedyModel=Qwen3-8B, Decoding Strategy=Greedy, Aggregation Strategy=majority voting2026.06500.7—
GreedyModel=Phi-4-RP-14B, Decoding Strategy=Greedy, Aggregation Strategy=majority voting2026.0643.30.73—