List your company

Multiple-choice Question Answering on MMLU-Pro Overall (test)

0.2456Mean Entropy (R1)DeepSeek V3.2
0.1987840.5147920.83081.146808Feb 9, 2026

Evaluation results

MethodLinks
DeepSeek V3.2Static Entropy Threshold (tau_H)=1.3 nats, Static Max Probability Threshold (tau_MSP)=0.4, Inference Protocol=Reinforcement Inference2026.020.24560.75460.19170.787275.9978.720.96
Qwen3 30BStatic Entropy Threshold (tau_H)=1.3 nats, Static Max Probability Threshold (tau_MSP)=0.4, Inference Protocol=Reinforcement Inference2026.021.28810.42921.30410.4376.3777.2557.5
Qwen3 235BStatic Entropy Threshold (tau_H)=1.3 nats, Static Max Probability Threshold (tau_MSP)=0.4, Inference Protocol=Reinforcement Inference2026.021.4160.37531.44140.375281.4482.5865.24