Code Translation (Python to Java) on HumanEval-X 1.0 (test)
41.98Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 41.98 | 58.17 | 72.78 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 29.27 | 45.7 | 64.45 | |
| InCoder-6.7BParameters=6.7B2023.03 | 26.74 | 42.66 | 61.2 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 25.84 | 41.52 | 59.72 |