List your company
ResearchFormerly WizWand

Multi-task Code Intelligence (Overall) on CodefuseEval & CodeXGLUE

46Overall ScoreGALLa
12.7221.363038.64Sep 6, 2024
Updated 8mo ago

Evaluation results

MethodLinks
GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C + GraphQA2024.0946
GALLaBackbone=LLAMA3 8B, Setting=G2C + GraphQA2024.0945.4
GALLaBackbone=LLAMA3 8B, Setting=G2C2024.0945
LLAMA3 8BSetting=Baseline2024.0944.6
GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C + GraphQA2024.0944.2
GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C2024.0944.2
GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C2024.0944.1
GALLaBackbone=Phi-1 1.3B, Setting=G2C + GraphQA2024.0943
Qwen2.5-Coder 14BSetting=Baseline2024.0942.3
GALLaBackbone=Phi-1 1.3B, Setting=G2C2024.0942.2
Phi-1 1.3BSetting=Baseline2024.0941.4
Qwen2.5-Coder 1.5BSetting=Baseline2024.0939.3
GALLaBackbone=CodeGen 350M, Setting=G2C + GraphQA2024.0936.6
GALLaBackbone=CodeGen 350M, Setting=G2C2024.0935.2
CodeGen 350MSetting=Baseline2024.0934.7
GALLaBackbone=LLAMA2 7B, Setting=G2C2024.0928.8
GALLaBackbone=LLAMA2 7B, Setting=G2C + GraphQA2024.0927.4
LLAMA2 7BSetting=Baseline2024.0926.9
GALLaBackbone=StarCoder 1B, Setting=G2C + GraphQA2024.0918.9
GALLaBackbone=StarCoder 1B, Setting=G2C2024.0916.7
StarCoder 1BSetting=Baseline2024.0914