Code Translation (Python to C++) on HumanEval-X 1.0 (test)
35.94Pass@1CodeGen-Multi-16B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeGen-Multi-16BParameters=16B2023.03 | 35.94 | 47.81 | 59.37 | |
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 34.16 | 46.86 | 61.22 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 26.54 | 43.56 | 56.48 | |
| InCoder-6.7BParameters=6.7B2023.03 | 26.11 | 41 | 54.25 |