Line-level code completion on JavaCorpus
37.9EMCodeT5+
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CodeT5+Parameters=770M, Mode=decoder-only adaptation2023.05 | 37.9 | 72.25 | |
| CodeGen-multiParameters=350M, Mode=decoder-only adaptation2023.05 | 35.47 | 69.22 | |
| CodeT5+Parameters=220M, Mode=decoder-only adaptation2023.05 | 35.17 | 69.48 | |
| UniXcoderParameters=125M, Mode=decoder-only adaptation2023.05 | 32.9 | 65.78 | |
| CodeGPTParameters=124M, Mode=decoder-only adaptation2023.05 | 30.6 | 63.45 | |
| PLBARTParameters=140M, Mode=decoder-only adaptation2023.05 | 26.97 | 61.59 | |
| CodeT5Parameters=220M, Mode=decoder-only adaptation2023.05 | 24.8 | 58.31 |