Code Completion on HumanEval (Pass@1)
0.652Pass@1NonDPFT
Evaluation results
| Method | Links | |
|---|---|---|
| NonDPFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=None2025.12 | 0.652 | |
| NonDPFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=None2025.12 | 0.598 | |
| NonDPFTBackbone=DS-Coder-6.7B, Privacy Epsilon=None2025.12 | 0.53 | |
| JFTBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.12 | 0.492 | |
| PrivCodeBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.12 | 0.488 | |
| DP-AdapterBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.12 | 0.478 | |
| PrivCodeBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.12 | 0.47 | |
| JFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.12 | 0.458 | |
| DPFTBackbone=DS-Coder-6.7B, Privacy Epsilon=42025.12 | 0.457 | |
| DP-AdapterBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.12 | 0.452 | |
| PrivCodeBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.12 | 0.439 | |
| DPFTBackbone=CodeQwen1.5-7B, Privacy Epsilon=42025.12 | 0.439 | |
| NonDPFTBackbone=CodeGemma-7B, Privacy Epsilon=None2025.12 | 0.433 | |
| PrivCodeBackbone=CodeGemma-7B, Privacy Epsilon=42025.12 | 0.402 | |
| JFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.12 | 0.388 | |
| DPFTBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.12 | 0.36 | |
| DP-AdapterBackbone=Qwen2.5-Coder-7B, Privacy Epsilon=42025.12 | 0.36 | |
| DP-AdapterBackbone=CodeGemma-7B, Privacy Epsilon=42025.12 | 0.347 | |
| JFTBackbone=CodeGemma-7B, Privacy Epsilon=42025.12 | 0.332 | |
| DPFTBackbone=CodeGemma-7B, Privacy Epsilon=42025.12 | 0.305 |