Coding (Pass@1) on LiveCodeBench (LCB)
56.7Pass@1CoT2-Meta
Evaluation results
| Method | Links | |
|---|---|---|
| CoT2-MetaStrategy=Ours (CoT2-Meta), Inference Budget=C=162026.03 | 56.7 | |
| ReST-MCTS*Strategy=ReST-MCTS*, Inference Budget=C=162026.03 | 53.2 | |
| Vanilla ToTStrategy=Vanilla ToT, Inference Budget=C=162026.03 | 51.2 | |
| Best-of-16Strategy=Best-of-16, Inference Budget=C=162026.03 | 47.8 | |
| Greedy CoTStrategy=Greedy CoT, Inference Budget=C=162026.03 | 42.5 |