Code Reasoning on LiveCodeBench (LCB) v6
15.3AccuracyINTUITOR
Evaluation Results
| Method | Links | |
|---|---|---|
| INTUITORModel=Qwen2.5-3B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 15.3 | |
| INTUITOR-CodeModel=Qwen2.5-3B, Training Data=Codeforces, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 15.3 | |
| INTUITORModel=Qwen2.5-1.5B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 9.9 | |
| BaseModel=Qwen2.5-3B, Training Data=-, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 9.3 | |
| GRPO-PVModel=Qwen2.5-3B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 8.6 | |
| GRPOModel=Qwen2.5-3B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 8.5 | |
| GRPOModel=Qwen2.5-1.5B, Training Data=MATH, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 5.6 | |
| BaseModel=Qwen2.5-1.5B, Training Data=-, Inference template=chat inference template, Decoding strategy=Greedy2025.05 | 0 |