Text-to-Code generation on CodeXGLUE (test)
22.65EMCodeT5-large
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeT5-largemodel size=large2022.07 | 22.65 | 42.66 | 45.08 | |
| UniXcoder2022.07 | 22.6 | 38.23 | — | |
| CodeT5-basemodel size=base2022.07 | 22.3 | 40.73 | 43.2 | |
| CodeT5-smallmodel size=small2022.07 | 21.55 | 38.13 | 41.39 | |
| CodeGPT-adapted2022.07 | 20.1 | 32.79 | 35.98 | |
| CoTexT2022.07 | 20.1 | 37.4 | 40.14 | |
| PLBART2022.07 | 18.75 | 36.69 | 38.52 | |
| CodeGPT-22022.07 | 18.25 | 28.69 | 32.71 | |
| GPT-22022.07 | 17.35 | 25.37 | 29.69 |