Code Translation (JavaScript to Java) on HumanEval-X 1.0 (test)
56.55Pass@1CodeGeeX-13B-FT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 56.55 | 70.27 | 80.71 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 33.79 | 56.06 | 74 | |
| InCoder-6.7BParameters=6.7B2023.03 | 30.67 | 50.9 | 71.03 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 24.68 | 48.35 | 69.03 |