List your company

Mathematical Reasoning on MATH-500 (AUCOAA)

91.9AUCOAANormalized-Length
80.87683.73886.689.462Jan 6, 2026

Evaluation results

MethodLinks
Normalized-LengthApproach=Normalized length reward, Backbone=Qwen3-8B2026.0191.9
Format-Adaptive-AnswerApproach=Format-based SFT + RL, Backbone=Qwen3-8B2026.0191.2
Adaptive-AnswerApproach=Rejection sampling + RL, Backbone=Qwen3-8B2026.0190.3
TWYNApproach=Baseline, Backbone=Qwen3-8B2026.0189.6
Hard-Length 8k → 4kApproach=Length decay strategy, Backbone=Qwen3-8B2026.0189.1
SFTApproach=Standard SFT, Backbone=Qwen3-8B2026.0187.9
Hard-Length 8kApproach=Hard length constraint 8k, Backbone=Qwen3-8B2026.0187.9
Soft-LengthApproach=Soft length constraint, Backbone=Qwen3-8B2026.0187.9
Hard-Length 16kApproach=Hard length constraint 16k, Backbone=Qwen3-8B2026.0183.4
Base modelApproach=Standard Reasoning, Backbone=Qwen3-8B2026.0181.7
No-ThinkingApproach=No CoT, Backbone=Qwen3-8B2026.0181.3