Program Synthesis on Karel (test)
86.04Generalization AccuracyExec
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Execbeam size=642021.06 | 86.04 | 39.4 | |
| LaSynthbeam size=642021.06 | 83.68 | 41.12 | |
| Shin et al.beam size=642021.06 | 81.3 | 42.8 | |
| Bunel et al.beam size=642021.06 | 77.12 | 32.17 |