Japanese-to-Python Code Generation on MCoNaLa (test)
37.3ChrF++gpt-3.5-turbo
Evaluation results
| Method | Links | |
|---|---|---|
| gpt-3.5-turbo2023.08 | 37.3 | |
| Prompt2Model w/o Data Ret.dataset retrieval=disabled2023.08 | 16.6 | |
| Prompt2Model w/o Model Ret.model retrieval=disabled2023.08 | 15.8 | |
| Prompt2Model2023.08 | 13.1 |