List your company
ResearchFormerly WizWand

Canary Leakage Evaluation on Joint Canary (train)

0Leakage RatePrivCode
-4235077Jun 8, 2026
Updated 4mo ago

Evaluation results

MethodLinks
PrivCodeModel=Qwen2.5-Coder-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCode++Model=Qwen2.5-Coder-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCodeModel=Qwen2.5-Coder-7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=Qwen2.5-Coder-7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=Qwen2.5-Coder-7B, Count=100, Privacy Budget (epsilon)=42026.060
NonDPFTModel=CodeGemma-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCodeModel=CodeGemma-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCode++Model=CodeGemma-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCodeModel=CodeGemma-7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=CodeGemma-7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=CodeGemma-7B, Count=100, Privacy Budget (epsilon)=42026.060
PrivCodeModel=CodeQwen1.5-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCode++Model=CodeQwen1.5-7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCodeModel=CodeQwen1.5-7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=CodeQwen1.5-7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=CodeQwen1.5-7B, Count=100, Privacy Budget (epsilon)=42026.060
NonDPFTModel=DS-Coder-6.7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCodeModel=DS-Coder-6.7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCode++Model=DS-Coder-6.7B, Count=5, Privacy Budget (epsilon)=42026.060
PrivCodeModel=DS-Coder-6.7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=DS-Coder-6.7B, Count=10, Privacy Budget (epsilon)=42026.060
PrivCode++Model=DS-Coder-6.7B, Count=100, Privacy Budget (epsilon)=42026.060
NonDPFTModel=Qwen2.5-Coder-7B, Count=5, Privacy Budget (epsilon)=42026.0620
PrivCodeModel=Qwen2.5-Coder-7B, Count=100, Privacy Budget (epsilon)=42026.0620
PrivCodeModel=CodeQwen1.5-7B, Count=100, Privacy Budget (epsilon)=42026.0620
NonDPFTModel=DS-Coder-6.7B, Count=10, Privacy Budget (epsilon)=42026.0620
PrivCodeModel=DS-Coder-6.7B, Count=100, Privacy Budget (epsilon)=42026.0620
NonDPFTModel=CodeGemma-7B, Count=10, Privacy Budget (epsilon)=42026.0640
PrivCodeModel=CodeGemma-7B, Count=100, Privacy Budget (epsilon)=42026.0640
NonDPFTModel=CodeQwen1.5-7B, Count=5, Privacy Budget (epsilon)=42026.0640
NonDPFTModel=CodeGemma-7B, Count=100, Privacy Budget (epsilon)=42026.0660
NonDPFTModel=Qwen2.5-Coder-7B, Count=10, Privacy Budget (epsilon)=42026.0680
NonDPFTModel=CodeQwen1.5-7B, Count=10, Privacy Budget (epsilon)=42026.0680
NonDPFTModel=DS-Coder-6.7B, Count=100, Privacy Budget (epsilon)=42026.0680
NonDPFTModel=Qwen2.5-Coder-7B, Count=100, Privacy Budget (epsilon)=42026.06100
NonDPFTModel=CodeQwen1.5-7B, Count=100, Privacy Budget (epsilon)=42026.06100