List your company
ResearchFormerly WizWand

Code Completion on BigCodeBench Full

46.1Pass@1NonDPFT
21.76428.08234.440.718Dec 5, 2025
Updated 8mo ago

Evaluation results

MethodLinks
NonDPFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=None2025.1246.1
NonDPFTBackbone=DS-Coder-6.7B, Privacy Epsilon=None2025.1239.5
NonDPFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=None2025.1239.3
PrivCodeBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.1236
PrivCodeBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.1235.5
DP-AdapterBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.1235
DPFTBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.1234.5
NonDPFTBackbone=CodeGemma-7B, Privacy Epsilon=None2025.1232.4
JFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.1232.4
JFTBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.1231.5
PrivCodeBackbone=CodeGemma-7B, Privacy Epsilon=42025.1230
DP-AdapterBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.1229.8
DPFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.1228.8
PrivCodeBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.1227.9
JFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.1227.2
DPFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.1226.7
DP-AdapterBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.1225.2
JFTBackbone=CodeGemma-7B, Privacy Epsilon=42025.1224.8
DP-AdapterBackbone=CodeGemma-7B, Privacy Epsilon=42025.1224.3
DPFTBackbone=CodeGemma-7B, Privacy Epsilon=42025.1222.7