Code-to-NL generation on CodeNN C# (test)
23.04BLEUCODE2SEQ
Evaluation results
| Method | Links | |
|---|---|---|
| CODE2SEQ2020.02 | 23.04 | |
| CODEBERTObjective=MLM+RTD2020.02 | 22.36 | |
| CODEBERTObjective=MLM2020.02 | 22.32 | |
| CODEBERTObjective=RTD2020.02 | 22.14 | |
| PRE-TRAIN W/ CODE ONLYTraining Data=Code snippets only2020.02 | 20.65 | |
| CODENN2020.02 | 20.53 | |
| TREELSTM2020.02 | 20.11 | |
| ROBERTA2020.02 | 19.81 | |
| 2-LAYER BILSTM2020.02 | 19.78 | |
| TRANSFORMER2020.02 | 19.68 | |
| SUM-NN2020.02 | 19.31 | |
| IR2020.02 | 13.66 | |
| MOSES2020.02 | 11.57 |