List your company
ResearchFormerly WizWand

Defect Detection on CodeXGLUE

0.534Defect RateLLAMA2 7B
0.530840.552170.57350.59483Sep 6, 2024
Updated 8mo ago

Evaluation results

MethodLinks
LLAMA2 7BSetting=Baseline2024.090.534
GALLaBackbone=LLAMA2 7B, Setting=G2C2024.090.535
StarCoder 1BSetting=Baseline2024.090.542
GALLaBackbone=StarCoder 1B, Setting=G2C2024.090.548
GALLaBackbone=LLAMA2 7B, Setting=G2C + GraphQA2024.090.552
GALLaBackbone=CodeGen 350M, Setting=G2C2024.090.565
GALLaBackbone=StarCoder 1B, Setting=G2C + GraphQA2024.090.565
LLAMA3 8BSetting=Baseline2024.090.567
GALLaBackbone=LLAMA3 8B, Setting=G2C2024.090.567
CodeGen 350MSetting=Baseline2024.090.569
GALLaBackbone=LLAMA3 8B, Setting=G2C + GraphQA2024.090.571
GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C + GraphQA2024.090.58
Qwen2.5-Coder 1.5BSetting=Baseline2024.090.584
Qwen2.5-Coder 14BSetting=Baseline2024.090.585
GALLaBackbone=CodeGen 350M, Setting=G2C + GraphQA2024.090.587
GALLaBackbone=Qwen2.5-Coder 14B, Setting=G2C2024.090.591
GALLaBackbone=Phi-1 1.3B, Setting=G2C + GraphQA2024.090.603
GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C2024.090.603
GALLaBackbone=Phi-1 1.3B, Setting=G2C2024.090.604
Phi-1 1.3BSetting=Baseline2024.090.611
GALLaBackbone=Qwen2.5-Coder 1.5B, Setting=G2C + GraphQA2024.090.613