Code Translation (JavaScript to Python) on HumanEval-X 1.0 (test)
67.63Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 67.63 | 81.88 | 89.3 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 35.52 | 52.23 | 69.78 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 31.15 | 54.02 | 72.36 | |
| InCoder-6.7BParameters=6.7B2023.03 | 23.18 | 50.47 | 67.26 |