List your company
ResearchFormerly WizWand

Code Summarization on CodeXGLUE Python (test)

21.01BLEU-4REDCODER
1.15646.310711.46516.6193Aug 26, 2021
Updated 8mo ago

Evaluation results

MethodLinks
REDCODERType=Retrieval augmented generative2021.0821.01
REDCODER-EXTType=Retrieval augmented generative2021.0820.91
BM25 + PLBARTType=Retrieval augmented generative2021.0819.57
PLBARTType=Generative2021.0819.3
CodeBERTType=Generative2021.0819.06
RoBERTaType=Generative2021.0818.14
GraphCodeBERTType=Generative2021.0817.98
Seq2SeqType=Generative2021.0815.93
TransformerType=Generative2021.0815.81
SCODE-RType=Retrieval based2021.0814.98
BM25Type=Retrieval based2021.081.92