List your company
ResearchFormerly WizWand

Code Generation on HumanEval (Pass@1, Pass@5, Pass@10)

41.7Pass@1ID-LoRA
22.25227.30132.3537.399Feb 24, 2026
Updated 8mo ago

Evaluation results

MethodLinks
ID-LoRABase Model=LLaMA-3-8B, Trainable Parameters (%)=0.56%2026.0241.754.558.5
LoRABase Model=LLaMA-3-8B, Trainable Parameters (%)=1.03%2026.023948.851.9
DoRABase Model=LLaMA-3-8B, Trainable Parameters (%)=1.05%2026.0238.350.255.7
ID-LoRABase Model=LLaMA-3-8B, # Params (%)=0.56%2026.0237.549.755
LoRABase Model=LLaMA-3-8B, # Params (%)=1.03%2026.0234.746.450.8
LoRABase Model=Mistral-7B, # Params (%)=1.15%2026.0233.842.445.3
DoRABase Model=Mistral-7B, # Params (%)=1.16%2026.0233.742.646.8
HydraLoRABase Model=Mistral-7B, # Params (%)=1.22%2026.0233.541.444.2
ID-LoRABase Model=Mistral-7B, # Params (%)=0.62%2026.0233.543.346.9
HydraLoRABase Model=LLaMA-3-8B, # Params (%)=1.10%2026.0233.444.749.3
HydraLoRABase Model=LLaMA-3-8B, Trainable Parameters (%)=1.10%2026.0233.243.947.8
DoRABase Model=LLaMA-3-8B, # Params (%)=1.05%2026.0233.14448.6
DoRABase Model=Mistral-7B, Trainable Parameters (%)=1.16%2026.0232.540.143.3
HydraLoRABase Model=Mistral-7B, Trainable Parameters (%)=1.22%2026.0232.441.745.6
ID-LoRABase Model=Mistral-7B, Trainable Parameters (%)=0.62%2026.0232.441.845.7
LoRABase Model=Mistral-7B, Trainable Parameters (%)=1.15%2026.0232.34145.2
FFTBase Model=LLaMA-3-8B, Trainable Parameters (%)=100%2026.0231.240.143.9
FFTBase Model=LLaMA-3-8B, # Params (%)=100%2026.0230.539.341.7
MoELoRABase Model=Mistral-7B, Trainable Parameters (%)=1.21%2026.0229.138.341.9
FFTBase Model=Mistral-7B, # Params (%)=100%2026.0229.138.540.4
MoELoRABase Model=LLaMA-3-8B, Trainable Parameters (%)=1.09%2026.0228.941.547.1
FFTBase Model=Mistral-7B, Trainable Parameters (%)=100%2026.022330.233.9