List your company
ResearchFormerly WizWand

Question Answering on ARC Challenge (pass@1)

94.1Pass@1Qwen3
15.16435.65756.1576.643Oct 16, 2025Nov 19, 2025Dec 24, 2025Jan 28, 2026Mar 4, 2026Apr 8, 2026May 13, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Qwen3Model Category=Original Models, Sampling Temperature=0.6, Shuffle options=true2026.0594.1
Qwen3-8192Model Category=Original Models, Max Generation Length=8192, Sampling Temperature=0.6, Shuffle options=true2026.0593.8
TGPO-annealingModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0582.8
TGPOModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0581.2
LUFFYModel Category=Off-Policy and Mixed-Policy, Sampling Temperature=0.6, Shuffle options=true2026.0580.1
TGPORModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0580.1
KDRLModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0578.4
GRPO++Model Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0577.4
PRIME-ZeroModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0573.3
SFTModel Category=Off-Policy and Mixed-Policy, Sampling Temperature=0.6, Shuffle options=true2026.0573.1
Oat-ZeroModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0570.1
SimpleRL-ZeroModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0530.2
DS-MTPModel Size=3B2025.1027.4
NTPModel Size=3B2025.1026.3
OP DistillModel Category=On-Policy Methods, Sampling Temperature=0.6, Shuffle options=true2026.0526.1
FSP-RevLMModel Size=3B2025.1025.5
MTPModel Size=3B2025.1024.5
Qwen2.5-Math-7BModel Category=Original Models, Sampling Temperature=0.6, Shuffle options=true2026.0518.2