Code Translation (Go to Python) on HumanEval-X 1.0 (test)
57.98Pass@1CodeGeeX-13B-FT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 57.98 | 79.04 | 93.57 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 38.32 | 50.57 | 68.65 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 35.92 | 56.02 | 77.32 | |
| InCoder-6.7BParameters=6.7B2023.03 | 34.14 | 54.52 | 70.88 |