List your company

Code Generation on HumanEval (Accuracy, Tokens, Ratio)

29.27AccuracyMCTS + EquivPruner
19.119621.754824.3927.0252May 22, 2025

Evaluation results

MethodLinks
MCTS + EquivPrunerModel=Qwen2.5-Math-7B-Instruct, Search Strategy=MCTS + EquivPruner2025.0529.2773796.09
Vanilla MCTSModel=Qwen2.5-Math-7B-Instruct, Search Strategy=Vanilla MCTS2025.0519.51767100