Code Translation (JavaScript to C++) on HumanEval-X 1.0 (test)
46.87Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 46.87 | 60.82 | 73.18 | |
| InCoder-6.7BParameters=6.7B2023.03 | 35.47 | 54.48 | 70.71 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 35.41 | 53.12 | 64.47 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 30.32 | 51.63 | 69.37 |