Extreme Code Summarization on CodeSearchNet JavaScript (test)
20.34PrecisionContraCode
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ContraCodeBackbone=Transformer, Training Protocol=Contrastive pre-training followed by fine-tuning with augmentations2020.07 | 20.34 | 14.96 | 17.24 | |
| TransformerTraining Protocol=Training from scratch2020.07 | 18.11 | 15.78 | 16.86 | |
| RoBERTa MLMTraining Protocol=MLM pre-training followed by fine-tuning, Pre-training Data=1.8M programs2020.07 | 15.13 | 11.47 | 12.45 | |
| code2seqArchitecture=Tree-structured AST, Training Protocol=Supervised2020.07 | 12.17 | 7.65 | 9.39 | |
| code2vecArchitecture=Tree-structured AST, Training Protocol=Supervised2020.07 | 10.78 | 8.24 | 9.34 |