Code Summarization on CodeXGLUE Code-Text
13.21BLEU-4IRCoder
Evaluation Results
| Method | Links | |
|---|---|---|
| IRCoderParameters=5.7B2024.03 | 13.21 | |
| DeepSeekCoderParameters=5.7B2024.03 | 11.8 | |
| IRCoderParameters=3.1B2024.03 | 11.74 | |
| IRCoderParameters=1.1B2024.03 | 11.41 | |
| IRCoderParameters=7.3B2024.03 | 11.16 | |
| IRCoderParameters=6.7B2024.03 | 11.15 | |
| IRCoderParameters=1.3B2024.03 | 10.79 | |
| StarCoderBaseParameters=7.3B2024.03 | 10.74 | |
| StarCoderBaseParameters=3.1B2024.03 | 10.61 | |
| StarCoderBaseParameters=1.1B2024.03 | 10.05 | |
| CodeLlamaParameters=6.7B2024.03 | 9.74 | |
| DeepSeekCoderParameters=1.3B2024.03 | 9.63 |