Code Translation (C++ to Java) on HumanEval-X 1.0 (test)
71.68Pass@1CodeGeeX-13B-FT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 71.68 | 81.62 | 85.84 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 43.2 | 69.84 | 88.82 | |
| InCoder-6.7BParameters=6.7B2023.03 | 34.04 | 57.02 | 68.7 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 22.56 | 40.91 | 64.08 |