Code-to-Documentation generation on CodeSearchNet (test)
12.16RubyCODEBERT (RTD+MLM)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CODEBERT (RTD+MLM)Pre-training Objective=RTD+MLM2020.02 | 12.16 | 14.9 | 18.07 | 19.06 | 17.65 | 25.16 | 17.83 | |
| PRE-TRAIN W/ CODE ONLYModality=Unimodal (Code-only)2020.02 | 11.91 | 13.99 | 17.78 | 18.58 | 17.5 | 24.34 | 17.35 | |
| CODEBERT (MLM)Pre-training Objective=MLM2020.02 | 11.57 | 14.41 | 17.78 | 18.77 | 17.38 | 24.85 | 17.46 | |
| CODEBERT (RTD)Pre-training Objective=RTD2020.02 | 11.42 | 13.27 | 17.53 | 18.29 | 17.35 | 24.1 | 17 | |
| TRANSFORMER2020.02 | 11.18 | 11.59 | 16.38 | 15.81 | 16.26 | 22.12 | 15.56 | |
| ROBERTA2020.02 | 11.17 | 11.9 | 17.72 | 18.14 | 16.47 | 24.02 | 16.57 | |
| SEQ2SEQ2020.02 | 9.64 | 10.21 | 13.98 | 15.93 | 15.09 | 21.08 | 14.32 |