List your company
ResearchFormerly WizWand

Code Repair on CodeXGLUE

15.7Repair RateGALLa
-0.3163.842812.158Sep 6, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C2024.0915.7
GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C + GraphQA2024.0915
GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C + GraphQA2024.0913.8
GALLaBackbone=LLAMA3 8B, Setting=G2C + GraphQA2024.0913.6
GALLaBackbone=LLAMA3 8B, Setting=G2C2024.0913.4
Qwen2.5-Coder 1.5BSetting=Baseline2024.0913.2
GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C2024.0913.1
Qwen2.5-Coder 14BSetting=Baseline2024.0912.7
LLAMA3 8BSetting=Baseline2024.0912.1
GALLaBackbone=Phi-1 1.3B, Setting=G2C2024.0910.9
GALLaBackbone=Phi-1 1.3B, Setting=G2C + GraphQA2024.0910.2
Phi-1 1.3BSetting=Baseline2024.0910.1
CodeGen 350MSetting=Baseline2024.099
GALLaBackbone=CodeGen 350M, Setting=G2C + GraphQA2024.098.6
GALLaBackbone=CodeGen 350M, Setting=G2C2024.098.5
GALLaBackbone=LLAMA2 7B, Setting=G2C + GraphQA2024.091.6
GALLaBackbone=LLAMA2 7B, Setting=G2C2024.091
LLAMA2 7BSetting=Baseline2024.090.8
GALLaBackbone=StarCoder 1B, Setting=G2C2024.090.6
StarCoder 1BSetting=Baseline2024.090.4
GALLaBackbone=StarCoder 1B, Setting=G2C + GraphQA2024.090.3