Code Generation on C++ code generation tasks (test)
22.6Pass@1NonDPFT
Evaluation Results
| Method | Links | |
|---|---|---|
| NonDPFTModel=CodeQwen1.5-7B, epsilon=None2025.12 | 22.6 | |
| PrivCode++Backbone=Qwen2.5-Coder-7B, Privacy budget (epsilon)=42026.06 | 22.6 | |
| PrivCodeModel=Qwen2.5-Coder-7B, epsilon=42025.12 | 22 | |
| PrivCodeBackbone=Qwen2.5-Coder-7B, Privacy budget (epsilon)=42026.06 | 22 | |
| NonDPFTModel=Qwen2.5-Coder-7B, epsilon=None2025.12 | 17.1 | |
| NonDPFTModel=CodeGemma-7B, epsilon=None2025.12 | 17.1 | |
| PrivCodeModel=CodeQwen1.5-7B, epsilon=42025.12 | 17.1 | |
| PrivCodeBackbone=CodeQwen1.5-7B, Privacy budget (epsilon)=42026.06 | 17.1 | |
| DPFTModel=Qwen2.5-Coder-7B, epsilon=42025.12 | 15.9 | |
| PretrainModel=Qwen2.5-Coder-7B, epsilon=None2025.12 | 14 | |
| JFTModel=CodeQwen1.5-7B, epsilon=42025.12 | 14 | |
| PretrainBackbone=Qwen2.5-Coder-7B2026.06 | 14 | |
| PrivCode++Backbone=CodeQwen1.5-7B, Privacy budget (epsilon)=42026.06 | 14 | |
| PrivCodeModel=CodeGemma-7B, epsilon=42025.12 | 12.8 | |
| PrivCodeBackbone=CodeGemma-7B, Privacy budget (epsilon)=42026.06 | 12.8 | |
| JFTModel=CodeGemma-7B, epsilon=42025.12 | 11.6 | |
| PrivCode++Backbone=CodeGemma-7B, Privacy budget (epsilon)=42026.06 | 11.6 | |
| JFTModel=Qwen2.5-Coder-7B, epsilon=42025.12 | 10.4 | |
| DPFTModel=CodeGemma-7B, epsilon=42025.12 | 9.1 | |
| DPFTModel=CodeQwen1.5-7B, epsilon=42025.12 | 7.9 | |
| PretrainModel=CodeGemma-7B, epsilon=None2025.12 | 0.6 | |
| PretrainBackbone=CodeGemma-7B2026.06 | 0.6 | |
| PretrainModel=CodeQwen1.5-7B, epsilon=None2025.12 | 0 | |
| PretrainBackbone=CodeQwen1.5-7B2026.06 | 0 |