Code Understanding and Generation on CodeXGLUE
46.3Code Refinement ScoreLOGO (Norm)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LOGO (Norm)Backbone=LLaMA-3.1-8B2025.11 | 46.3 | 11.2 | 7.6 | 1 | 6.1 | 14.4 | |
| LOGO (Entropy)Backbone=LLaMA-3.1-8B2025.11 | 41.5 | 10.6 | 11.7 | 1.1 | 3.7 | 13.7 | |
| Adapter SoupBackbone=LLaMA-3.1-8B2025.11 | 41.3 | 9.1 | 9.2 | 1.1 | 1.7 | 12.5 | |
| LoRA HubBackbone=LLaMA-3.1-8B2025.11 | 33.5 | 9.7 | 10.4 | 1.5 | 3.2 | 11.6 | |
| LoRA RetrieverBackbone=LLaMA-3.1-8B2025.11 | 29.2 | 10.7 | 9.4 | 1.2 | 1.5 | 10.4 | |
| BaseBackbone=LLaMA-3.1-8B2025.11 | 13.8 | 0.2 | 1.6 | 1.8 | 1.5 | 3.8 |