Code Translation (Java to Go) on HumanEval-X 1.0 (test)
34Pass@1CodeGen-Multi-16B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeGen-Multi-16BParameters=16B2023.03 | 34 | 48.49 | 67.94 | |
| InCoder-6.7BParameters=6.7B2023.03 | 21.58 | 35.2 | 54.97 | |
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 18.85 | 32.92 | 48.93 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 17.17 | 32.74 | 47.71 |