Text-to-Code Retrieval on CodeXGLUE AdvTest
44.7MRRCodeT5+
Evaluation results
| Method | Links | |
|---|---|---|
| CodeT5+Parameters=770M2023.05 | 44.7 | |
| CodeT5+Parameters=220M2023.05 | 43.3 | |
| UniXcoderParameters=125M2023.05 | 41.3 | |
| CodeT5Parameters=220M2023.05 | 39.3 | |
| SYNCOBERTParameters=125M2023.05 | 38.3 | |
| GraphCodeBERTParameters=125M2023.05 | 35.2 | |
| CodeGen-multiParameters=350M2023.05 | 34.8 | |
| PLBARTParameters=140M2023.05 | 34.7 | |
| CodeBERTParameters=125M2023.05 | 27.2 |