Code Summarization on CodeXGLUE (test)
20.63Overall ScoreCodeGeeX
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CodeGeeXMode=Fine-tuned, Temperature=0.2, Top-p=0.952023.03 | 20.63 | 10.05 | 16.01 | 24.62 | 22.5 | 19.6 | 31 | |
| DistillCodeT5Mode=Fine-tuned2023.03 | 20.01 | 15.75 | 16.42 | 20.21 | 20.59 | 20.51 | 26.58 | |
| PolyglotCodeBERTMode=Fine-tuned2023.03 | 19.06 | 14.75 | 15.8 | 18.77 | 18.71 | 20.11 | 26.23 | |
| CoTexTMode=Fine-tuned2023.03 | 18.55 | 14.02 | 14.96 | 18.86 | 19.73 | 19.06 | 24.68 | |
| ProphetNet-XMode=Fine-tuned2023.03 | 18.54 | 14.37 | 16.6 | 18.43 | 17.87 | 19.39 | 24.57 | |
| PLBARTMode=Fine-tuned2023.03 | 18.32 | 14.11 | 15.56 | 18.91 | 19.3 | 18.45 | 23.58 | |
| CodeBERTMode=Fine-tuned2023.03 | 17.83 | 12.16 | 14.9 | 18.07 | 19.06 | 17.65 | 25.16 |