List your company
ResearchFormerly WizWand

Code Completion on BigCodeBench Hard

16.2Pass@1NonDPFT
5.3848.1921113.808Dec 5, 2025
Updated 8mo ago

Evaluation results

MethodLinks
NonDPFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=None2025.1216.2
NonDPFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=None2025.1212.1
PrivCodeBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.129.4
JFTBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.128.8
PrivCodeBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.128.8
PrivCodeBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.128.8
PrivCodeBackbone=CodeGemma-7B, Privacy Epsilon=42025.128.7
DP-AdapterBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.128.4
NonDPFTBackbone=DS-Coder-6.7B, Privacy Epsilon=None2025.128.1
DPFTBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.128.1
NonDPFTBackbone=CodeGemma-7B, Privacy Epsilon=None2025.128.1
JFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.128
JFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.127.9
DP-AdapterBackbone=CodeGemma-7B, Privacy Epsilon=42025.127.7
DPFTBackbone=CodeGemma-7B, Privacy Epsilon=42025.127.4
DPFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.127.4
JFTBackbone=CodeGemma-7B, Privacy Epsilon=42025.127.2
DP-AdapterBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.126.7
DPFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.126.1
DP-AdapterBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.125.8