Code Summarization on CodeSearchNet-Java (CodeXGLUE test)
20.55Smoothed BLEU-4CodeT5 (Base)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CodeT5 (Base)Token Removal Ratio=0% (Base)2025.05 | 20.55 | — | 22 | — | |
| LEANCODEBackbone=CodeT5, Token Removal Ratio=10%2025.05 | 20.32 | 1.11 | 20 | 9.09 | |
| LEANCODEBackbone=CodeT5, Token Removal Ratio=20%2025.05 | 20.18 | 1.8 | 18 | 18.18 | |
| SlimCodeBackbone=CodeT5, Token Removal Ratio=10%2025.05 | 20.01 | 2.62 | 20 | 9.09 | |
| LEANCODEBackbone=CodeT5, Token Removal Ratio=30%2025.05 | 19.82 | 3.55 | 16 | 27.27 | |
| SlimCodeBackbone=CodeT5, Token Removal Ratio=20%2025.05 | 19.68 | 4.23 | 18 | 18.18 | |
| LEANCODEBackbone=CodeT5, Token Removal Ratio=40%2025.05 | 19.27 | 6.22 | 15 | 31.81 | |
| PGNN-EKdecoder=6-layer Transformer-based2022.05 | 18.95 | — | — | — | |
| SlimCodeBackbone=CodeT5, Token Removal Ratio=30%2025.05 | 18.74 | 8.8 | 16 | 27.27 | |
| LEANCODEBackbone=CodeT5, Token Removal Ratio=50%2025.05 | 18.46 | 10.17 | 13 | 40.9 | |
| PLBART2022.05 | 18.45 | — | — | — | |
| CodeBERT (Base)Token Removal Ratio=0% (Base)2025.05 | 18.25 | — | 29 | — | |
| LEANCODEBackbone=CodeBERT, Token Removal Ratio=10%2025.05 | 18.08 | 0.93 | 27 | 6.89 | |
| SlimCodeBackbone=CodeBERT, Token Removal Ratio=10%2025.05 | 17.86 | 2.13 | 27 | 6.89 | |
| LEANCODEBackbone=CodeBERT, Token Removal Ratio=20%2025.05 | 17.73 | 2.84 | 26 | 10.34 | |
| CodeBERT2022.05 | 17.65 | — | — | — | |
| SlimCodeBackbone=CodeBERT, Token Removal Ratio=20%2025.05 | 17.35 | 4.93 | 26 | 10.34 | |
| DIETCODEBackbone=CodeT5, Token Removal Ratio=10%2025.05 | 17.27 | 15.96 | 20 | 9.09 | |
| LEANCODEBackbone=CodeBERT, Token Removal Ratio=30%2025.05 | 17.23 | 5.58 | 24 | 17.24 | |
| SlimCodeBackbone=CodeBERT, Token Removal Ratio=30%2025.05 | 16.8 | 7.94 | 24 | 17.24 | |
| LEANCODEBackbone=CodeBERT, Token Removal Ratio=40%2025.05 | 16.71 | 8.43 | 23 | 20.68 | |
| DIETCODEBackbone=CodeT5, Token Removal Ratio=20%2025.05 | 16.48 | 19.8 | 18 | 18.18 | |
| DIETCODEBackbone=CodeBERT, Token Removal Ratio=10%2025.05 | 16.44 | 9.91 | 27 | 6.89 | |
| SlimCodeBackbone=CodeT5, Token Removal Ratio=40%2025.05 | 16.35 | 20.43 | 15 | 31.81 | |
| LEANCODEBackbone=CodeBERT, Token Removal Ratio=50%2025.05 | 16.24 | 11.01 | 22 | 24.13 | |
| SlimCodeBackbone=CodeBERT, Token Removal Ratio=40%2025.05 | 15.95 | 12.6 | 23 | 20.68 | |
| DIETCODEBackbone=CodeT5, Token Removal Ratio=30%2025.05 | 15.74 | 23.4 | 16 | 27.27 | |
| DIETCODEBackbone=CodeBERT, Token Removal Ratio=20%2025.05 | 15.68 | 14.08 | 26 | 10.34 | |
| SlimCodeBackbone=CodeBERT, Token Removal Ratio=50%2025.05 | 15.28 | 16.27 | 22 | 24.13 | |
| DIETCODEBackbone=CodeT5, Token Removal Ratio=40%2025.05 | 15.11 | 26.47 | 15 | 31.81 | |
| DIETCODEBackbone=CodeBERT, Token Removal Ratio=30%2025.05 | 15.05 | 17.53 | 24 | 17.24 | |
| DIETCODEBackbone=CodeBERT, Token Removal Ratio=40%2025.05 | 14.66 | 19.67 | 23 | 20.68 | |
| SlimCodeBackbone=CodeT5, Token Removal Ratio=50%2025.05 | 14.53 | 29.29 | 13 | 40.9 | |
| DIETCODEBackbone=CodeT5, Token Removal Ratio=50%2025.05 | 14.27 | 30.55 | 13 | 40.9 | |
| DIETCODEBackbone=CodeBERT, Token Removal Ratio=50%2025.05 | 14.23 | 22.02 | 22 | 24.13 | |
| Rencos2022.05 | 11.8 | — | — | — | |
| NCS2022.05 | 11.19 | — | — | — | |
| CodeNN2022.05 | 8.58 | — | — | — |