Code Translation (C++ to Python) on HumanEval-X 1.0 (test)
62.79Pass@1CodeGeeX-13B-FT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 62.79 | 80.39 | 87.1 | |
| InCoder-6.7BParameters=6.7B2023.03 | 34.37 | 58.41 | 78.57 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 33.83 | 55.37 | 76.64 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 27.18 | 49.02 | 67.69 |