Program Synthesis on IO2CodeBench
61.29Base ScoreCodeEvolve
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CodeEvolveToken/iter=5829.322026.05 | 61.29 | 60 | 44.44 | 32.67 | 49.6 | |
| DIO-AgentToken/iter=3738.312026.05 | 61.29 | 71.43 | 61.11 | 40.67 | 58.63 | |
| E-PBEToken/iter=1915.142026.05 | 51.61 | 60 | 22.22 | 20.67 | 38.63 | |
| AlphaEvolveToken/iter=4130.422026.05 | 51.61 | 60 | 55.56 | 22 | 47.29 | |
| FunSearchToken/iter=2911.992026.05 | 46.77 | 65.71 | 38.89 | 28.67 | 45.01 | |
| Direct2026.05 | 35.48 | 48.57 | 33.33 | 11.33 | 32.18 | |
| PBE2026.05 | 20.97 | 20 | 0 | 17.33 | 14.58 | |
| TDD-guided GenerationToken/iter=544.902026.05 | 20.97 | 48.57 | 61.11 | 19.33 | 37.5 |