List your company
ResearchFormerly WizWand

Code Reasoning on LiveCodeBench (LCB) v6

15.3AccuracyINTUITOR
-0.6123.5197.6511.781May 26, 2025
Updated 8mo ago

Evaluation results

MethodLinks
INTUITORModel=Qwen2.5-3B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.0515.3
INTUITOR-CodeModel=Qwen2.5-3B, Training Data=Codeforces, Inference template=chat inference template, Decoding strategy=Greedy2025.0515.3
INTUITORModel=Qwen2.5-1.5B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.059.9
BaseModel=Qwen2.5-3B, Training Data=-, Inference template=chat inference template, Decoding strategy=Greedy2025.059.3
GRPO-PVModel=Qwen2.5-3B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.058.6
GRPOModel=Qwen2.5-3B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.058.5
GRPOModel=Qwen2.5-1.5B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.055.6
BaseModel=Qwen2.5-1.5B, Training Data=-, Inference template=chat inference template, Decoding strategy=Greedy2025.050