Code Translation on CodefuseEval
80.5Ja2Py ScoreLLAMA3 8B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLAMA3 8BSetting=Baseline2024.09 | 80.5 | 74.8 | |
| GALLaBackbone=LLAMA3 8B, Setting=G2C2024.09 | 80.5 | 77 | |
| GALLaBackbone=LLAMA3 8B, Setting=G2C + GraphQA2024.09 | 80.5 | 78.2 | |
| Phi-1 1.3BSetting=Baseline2024.09 | 73.8 | 53.3 | |
| GALLaBackbone=Phi-1 1.3B, Setting=G2C + GraphQA2024.09 | 72 | 66.3 | |
| GALLaBackbone=LLAMA2 7B, Setting=G2C2024.09 | 69.5 | 59.1 | |
| GALLaBackbone=Phi-1 1.3B, Setting=G2C2024.09 | 67.7 | 64.3 | |
| GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C + GraphQA2024.09 | 65.2 | 76 | |
| GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C2024.09 | 64 | 77.4 | |
| GALLaBackbone=LLAMA2 7B, Setting=G2C + GraphQA2024.09 | 64 | 53.3 | |
| GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C + GraphQA2024.09 | 64 | 83.4 | |
| LLAMA2 7BSetting=Baseline2024.09 | 59.7 | 56.1 | |
| GALLaBackbone=CodeGen 350M, Setting=G2C + GraphQA2024.09 | 50 | 45.3 | |
| GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C2024.09 | 50 | 82.8 | |
| GALLaBackbone=CodeGen 350M, Setting=G2C2024.09 | 42.7 | 43.3 | |
| CodeGen 350MSetting=Baseline2024.09 | 40.2 | 42.3 | |
| Qwen2.5-Coder 14BSetting=Baseline2024.09 | 38.4 | 82.1 | |
| Qwen2.5-Coder 1.5BSetting=Baseline2024.09 | 35.4 | 73.8 | |
| GALLaBackbone=StarCoder 1B, Setting=G2C2024.09 | 6.1 | 1.2 | |
| GALLaBackbone=StarCoder 1B, Setting=G2C + GraphQA2024.09 | 6.1 | 1.2 | |
| StarCoder 1BSetting=Baseline2024.09 | 0.6 | 0 |