Code Translation (Go to Java) on HumanEval-X 1.0 (test)
54.22Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 54.22 | 69.03 | 79.4 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 36.55 | 59.12 | 78.7 | |
| InCoder-6.7BParameters=6.7B2023.03 | 34.52 | 53.95 | 69.92 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 22.89 | 41.04 | 61.46 |