List your company
ResearchFormerly WizWand

Code Generation on Rust code generation tasks (test)

50.6Pass@1NonDPFT
11.28821.49431.741.906Dec 5, 2025
Updated 8mo ago

Evaluation results

MethodLinks
NonDPFTModel=Qwen2.5-Coder-7B, epsilon=None2025.1250.6
PretrainModel=Qwen2.5-Coder-7B, epsilon=None2025.1247
PrivCodeModel=Qwen2.5-Coder-7B, epsilon=42025.1244.5
PrivCodeModel=CodeQwen1.5-7B, epsilon=42025.1242.7
PretrainModel=CodeQwen1.5-7B, epsilon=None2025.1240.2
NonDPFTModel=CodeQwen1.5-7B, epsilon=None2025.1239
JFTModel=Qwen2.5-Coder-7B, epsilon=42025.1237.7
DPFTModel=CodeQwen1.5-7B, epsilon=42025.1236
JFTModel=CodeQwen1.5-7B, epsilon=42025.1232.3
NonDPFTModel=CodeGemma-7B, epsilon=None2025.1231.7
PrivCodeModel=CodeGemma-7B, epsilon=42025.1228.7
PretrainModel=CodeGemma-7B, epsilon=None2025.1228
DPFTModel=CodeGemma-7B, epsilon=42025.1223.8
DPFTModel=Qwen2.5-Coder-7B, epsilon=42025.1222
JFTModel=CodeGemma-7B, epsilon=42025.1212.8