Line-level code completion on PY150
44.86EMCodeT5+
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CodeT5+Parameters=770M, Mode=decoder-only adaptation2023.05 | 44.86 | 74.22 | |
| CodeT5+Parameters=220M, Mode=decoder-only adaptation2023.05 | 43.42 | 73.69 | |
| UniXcoderParameters=125M, Mode=decoder-only adaptation2023.05 | 43.12 | 72 | |
| CodeGen-multiParameters=350M, Mode=decoder-only adaptation2023.05 | 42.47 | 70.67 | |
| CodeGPTParameters=124M, Mode=decoder-only adaptation2023.05 | 42.37 | 71.59 | |
| PLBARTParameters=140M, Mode=decoder-only adaptation2023.05 | 38.01 | 68.46 | |
| CodeT5Parameters=220M, Mode=decoder-only adaptation2023.05 | 36.97 | 67.12 |