Code Summarization on CodeXGLUE Python (test)
21.01BLEU-4REDCODER
Evaluation Results
| Method | Links | |
|---|---|---|
| REDCODERType=Retrieval augmented generative2021.08 | 21.01 | |
| REDCODER-EXTType=Retrieval augmented generative2021.08 | 20.91 | |
| BM25 + PLBARTType=Retrieval augmented generative2021.08 | 19.57 | |
| PLBARTType=Generative2021.08 | 19.3 | |
| CodeBERTType=Generative2021.08 | 19.06 | |
| RoBERTaType=Generative2021.08 | 18.14 | |
| GraphCodeBERTType=Generative2021.08 | 17.98 | |
| Seq2SeqType=Generative2021.08 | 15.93 | |
| TransformerType=Generative2021.08 | 15.81 | |
| SCODE-RType=Retrieval based2021.08 | 14.98 | |
| BM25Type=Retrieval based2021.08 | 1.92 |