Code Generation on BigCodeBench (Pass rate)
54Pass RateTarun (Llama-3.3-70B password-locked organism)
Evaluation results
| Method | Links | |
|---|---|---|
| Tarun (Llama-3.3-70B password-locked organism)Condition=Password (unlocked)2026.06 | 54 | |
| Causal Perturbative Elicitation (CPE)Condition=Locked + CPE, Base Model=Tarun (Llama-3.3-70B password-locked organism)2026.06 | 52 | |
| Tarun (Llama-3.3-70B password-locked organism)Condition=Locked (no password)2026.06 | 43 |