List your company
ResearchFormerly WizWand

Code Generation on C++ code generation tasks (test)

22.6Pass@1NonDPFT
-0.9045.19811.317.402Dec 5, 2025Jan 4, 2026Feb 4, 2026Mar 7, 2026Apr 7, 2026May 8, 2026Jun 8, 2026
Updated 4mo ago

Evaluation results

MethodLinks
NonDPFTModel=CodeQwen1.5-7B, epsilon=None2025.1222.6
PrivCode++Backbone=Qwen2.5-Coder-7B, Privacy budget (epsilon)=42026.0622.6
PrivCodeModel=Qwen2.5-Coder-7B, epsilon=42025.1222
PrivCodeBackbone=Qwen2.5-Coder-7B, Privacy budget (epsilon)=42026.0622
NonDPFTModel=Qwen2.5-Coder-7B, epsilon=None2025.1217.1
NonDPFTModel=CodeGemma-7B, epsilon=None2025.1217.1
PrivCodeModel=CodeQwen1.5-7B, epsilon=42025.1217.1
PrivCodeBackbone=CodeQwen1.5-7B, Privacy budget (epsilon)=42026.0617.1
DPFTModel=Qwen2.5-Coder-7B, epsilon=42025.1215.9
PretrainModel=Qwen2.5-Coder-7B, epsilon=None2025.1214
JFTModel=CodeQwen1.5-7B, epsilon=42025.1214
PretrainBackbone=Qwen2.5-Coder-7B2026.0614
PrivCode++Backbone=CodeQwen1.5-7B, Privacy budget (epsilon)=42026.0614
PrivCodeModel=CodeGemma-7B, epsilon=42025.1212.8
PrivCodeBackbone=CodeGemma-7B, Privacy budget (epsilon)=42026.0612.8
JFTModel=CodeGemma-7B, epsilon=42025.1211.6
PrivCode++Backbone=CodeGemma-7B, Privacy budget (epsilon)=42026.0611.6
JFTModel=Qwen2.5-Coder-7B, epsilon=42025.1210.4
DPFTModel=CodeGemma-7B, epsilon=42025.129.1
DPFTModel=CodeQwen1.5-7B, epsilon=42025.127.9
PretrainModel=CodeGemma-7B, epsilon=None2025.120.6
PretrainBackbone=CodeGemma-7B2026.060.6
PretrainModel=CodeQwen1.5-7B, epsilon=None2025.120
PretrainBackbone=CodeQwen1.5-7B2026.060