Text-to-Code Retrieval on CodeSearchNet CodeXGLUE
78Ruby ScoreCodeT5+
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CodeT5+Parameters=770M2023.05 | 78 | 71.3 | 92.7 | 75.8 | 76.2 | 70.1 | 77.4 | |
| CodeT5+Parameters=220M2023.05 | 77.7 | 70.8 | 92.4 | 75.6 | 76.1 | 69.8 | 77.1 | |
| UniXcoderParameters=125M2023.05 | 74 | 68.4 | 91.5 | 72 | 72.6 | 67.6 | 74.4 | |
| SYNCOBERTParameters=125M2023.05 | 72.2 | 67.7 | 91.3 | 72.4 | 72.3 | 67.8 | 74 | |
| CodeT5Parameters=220M2023.05 | 71.9 | 65.5 | 88.8 | 69.8 | 68.6 | 64.5 | 71.5 | |
| GraphCodeBERTParameters=125M2023.05 | 70.3 | 64.4 | 89.7 | 69.2 | 69.1 | 64.9 | 71.3 | |
| CodeBERTParameters=125M2023.05 | 67.9 | 62 | 88.2 | 67.2 | 67.6 | 62.8 | 69.3 | |
| PLBARTParameters=140M2023.05 | 67.5 | 61.6 | 88.7 | 66.3 | 66.3 | 61.1 | 68.6 | |
| CodeGen-multiParameters=350M2023.05 | 66 | 62.2 | 90 | 68.6 | 70.1 | 63.9 | 70.1 |