List your company
ResearchFormerly WizWand

Code Generation on LeetCode without write access

15.2Pass@1No intervention
0.644.428.211.98Apr 1, 2026
Updated 7mo ago

Evaluation results

MethodLinks
No interventionModel=Phi-4-mini, Write access=false2026.0415.2
Adv. Mod. (multiplicative)Model=Phi-4-mini, Alpha (α)=2.0, Write access=false2026.0415
Adv. Mod. (additive)Model=Phi-4-mini, Alpha (α)=2.0, Write access=false2026.0412.7
Gen.-time suppressionModel=Phi-4-mini, Write access=false2026.0412.6
Adv. Mod. (multiplicative)Model=Phi-4-mini, alpha=2.02026.0412
No interventionModel=Llama-3.2-3B, Write access=false2026.046.8
Adv. Mod. (multiplicative)Model=Llama-3.2-3B, Alpha (α)=2.0, Write access=false2026.046.8
Gen.-time suppressionModel=Llama-3.2-3B, Write access=false2026.046.6
Adv. Mod. (additive)Model=Llama-3.2-3B, Alpha (α)=2.0, Write access=false2026.046.4
Gen.-time suppressionModel=Phi-4-mini2026.046.1
Adv. Mod. (multiplicative)Model=Llama-3.2-3B, alpha=2.02026.045.1
Adv. Mod. (additive)Model=Phi-4-mini, alpha=2.02026.044.2
Gen.-time suppressionModel=Llama-3.2-3B2026.043
Adv. Mod. (additive)Model=Llama-3.2-3B, alpha=2.02026.043
No interventionModel=Llama-3.2-3B2026.041.9
No interventionModel=Phi-4-mini2026.041.2