Conditional Code Generation on Conala
16.4Conditional PerplexityG-Star+
Evaluation Results
| Method | Links | |
|---|---|---|
| G-Star+t_on=0.3, Sampling Steps=1282025.10 | 16.4 | |
| G-Star-loopSampling Steps=642025.10 | 17.8 | |
| G-Star-loopSampling Steps=1282025.10 | 17.8 | |
| G-Star+t_on=0.3, Sampling Steps=642025.10 | 18.9 | |
| ReMDM-capη=0.04, Sampling Steps=1282025.10 | 19.1 | |
| ReMDM-loopη=0.02, Sampling Steps=1282025.10 | 20.4 | |
| G-Star+t_on=0.3, Sampling Steps=322025.10 | 20.4 | |
| ReMDM-capη=0.04, Sampling Steps=642025.10 | 22.5 | |
| G-Star-loopSampling Steps=322025.10 | 22.5 | |
| ReMDM-loopη=0.02, Sampling Steps=642025.10 | 25 | |
| MDLMSampling Steps=642025.10 | 25.5 | |
| MDLMSampling Steps=1282025.10 | 26.7 | |
| ReMDM-capη=0.04, Sampling Steps=322025.10 | 27.3 | |
| MDLMSampling Steps=322025.10 | 29.8 | |
| ReMDM-loopη=0.02, Sampling Steps=322025.10 | 30.1 |