List your company
ResearchFormerly WizWand

Mathematical Problem Solving on MATH 500 (Pass@1, Avg)

89.5Pass@1Qwen-2-7B w/ T3RL
0.99623.97346.9569.927Mar 2, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Qwen-2-7B w/ T3RLModel Category=Vanilla Model, Backbone=Qwen-2-7B, Training Method=T3RL2026.0389.568.1
Qwen-2-7B w/ TTRLModel Category=Vanilla Model, Backbone=Qwen-2-7B, Training Method=TTRL2026.0388.465.5
Qwen-2.5-Math-1.5B w/ T3RLModel Category=Math Model, Backbone=Qwen-2.5-Math-1.5B, Training Method=T3RL2026.0374.648.8
Qwen-2.5-Math-1.5B w/ TTRLModel Category=Math Model, Backbone=Qwen-2.5-Math-1.5B, Training Method=TTRL2026.037345.9
Qwen-2.5-1.5B w/ T3RLModel Category=Vanilla Model, Backbone=Qwen-2.5-1.5B, Training Method=T3RL2026.036533.3
Llama-3-8B-Instruct w/ T3RLModel Category=Instruct Model, Backbone=Llama-3-8B-Instruct, Training Method=T3RL2026.0363.338.2
Qwen-2.5-1.5B w/ TTRLModel Category=Vanilla Model, Backbone=Qwen-2.5-1.5B, Training Method=TTRL2026.0363.231.8
Llama-3-8B-Instruct w/ TTRLModel Category=Instruct Model, Backbone=Llama-3-8B-Instruct, Training Method=TTRL2026.0361.635.4
Qwen-2-7B (Baseline)Model Category=Vanilla Model, Backbone=Qwen-2-7B, Training Method=Baseline2026.0350.421
Llama-3-8B-Instruct (Baseline)Model Category=Instruct Model, Backbone=Llama-3-8B-Instruct, Training Method=Baseline2026.0343.923.1
Llama-3.2-1B-Instruct w/ T3RLModel Category=Instruct Model, Backbone=Llama-3.2-1B-Instruct, Training Method=T3RL2026.0342.223.5
Llama-3.2-1B-Instruct w/ TTRLModel Category=Instruct Model, Backbone=Llama-3.2-1B-Instruct, Training Method=TTRL2026.034021.5
Qwen-2.5-Math-1.5B (Baseline)Model Category=Math Model, Backbone=Qwen-2.5-Math-1.5B, Training Method=Baseline2026.0332.723
Qwen-2.5-1.5B (Baseline)Model Category=Vanilla Model, Backbone=Qwen-2.5-1.5B, Training Method=Baseline2026.037.72.8
Llama-3.2-1B-Instruct (Baseline)Model Category=Instruct Model, Backbone=Llama-3.2-1B-Instruct, Training Method=Baseline2026.034.43.1