Code Translation (Go to C++) on HumanEval-X 1.0 (test)
38.97Pass@1CodeGeeX-13B-FT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CodeGeeX-13B-FTParameters=13B, Fine-tuned=true2023.03 | 38.97 | 53.05 | 63.92 | |
| CodeGen-Multi-16BParameters=16B2023.03 | 32.95 | 45.88 | 59.56 | |
| InCoder-6.7BParameters=6.7B2023.03 | 30.45 | 48.47 | 62.81 | |
| CodeGeeX-13BParameters=13B, Fine-tuned=false2023.03 | 29.83 | 41.98 | 58.15 |