Code Translation (Java to C++) on HumanEval-X 1.0 (test)
49.67Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 49.67 | 65.65 | 75.4 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 41.42 | 54.68 | 65.5 | |
| InCoder-6.7BParameters=6.7B2023.03 | 40.01 | 55.17 | 70.39 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 39.33 | 58.48 | 72.36 |