Regex Synthesis on REGEX STREGEX
59.7AccuracySATLM
Evaluation results
| Method | Links | |
|---|---|---|
| SATLMLanguage Model=code-davinci-002, Decoding Method=self-consistency decoding2023.05 | 59.7 | |
| PROGLMLanguage Model=code-davinci-002, Decoding Method=self-consistency decoding2023.05 | 56.5 | |
| SATLMLanguage Model=code-davinci-002, Decoding Method=greedy decoding2023.05 | 41 | |
| PROGLMLanguage Model=code-davinci-002, Decoding Method=greedy decoding2023.05 | 39.1 |