Code Translation (Java to Python) on HumanEval-X 1.0 (test)
75.03Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 75.03 | 87.71 | 95.13 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 52.73 | 69.3 | 82.74 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 43.41 | 68.46 | 84.03 | |
| InCoder-6.7BParameters=6.7B2023.03 | 42.76 | 65.55 | 80.43 |