List your company
ResearchFormerly WizWand

Multitask Knowledge Evaluation on MMLU-Pro

80Pass@1Qwen3
14.37631.41348.4565.487May 13, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Qwen3Model Category=Original Models, Sampling Temperature=0.6, Shuffle options=true2026.0580
Qwen3-8192Model Category=Original Models, Max Generation Length=8192, Sampling Temperature=0.6, Shuffle options=true2026.0576.5
LUFFYModel Category=Off-Policy and Mixed-Policy, Sampling Temperature=0.6, Shuffle options=true2026.0550.1
TGPO-annealingModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0550.1
TGPOModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0548.9
TGPORModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0548.1
GRPO++Model Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0546.9
KDRLModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0546.9
SFTModel Category=Off-Policy and Mixed-Policy, Sampling Temperature=0.6, Shuffle options=true2026.0544.9
Oat-ZeroModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0541.7
SimpleRL-ZeroModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0534.5
PRIME-ZeroModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0532.7
OP DistillModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0523
Qwen2.5-Math-7BModel Category=Original Models, Sampling Temperature=0.6, Shuffle options=true2026.0516.9