Code Translation on HumanEval-X
89.8Pass@1 (Python)INTERVENOR
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| INTERVENOR2023.11 | 89.8 | 75.6 | 85.4 | 88.3 | |
| GPT-3.52023.11 | 84.3 | 71.5 | 81.7 | 84.6 | |
| CodeGeeX2023.11 | 68.5 | 43.6 | 56.8 | 45.2 | |
| CodeGen2023.11 | 40.7 | 37.6 | 35.4 | 51.8 |
Loading the SOTA2 catalog…