Code Generation on MBPP (Pass@1, Pass@10)
41Pass@1LLaMA3-8B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LLaMA3-8BVariant=Baseline2026.01 | 41 | 69 | |
| LLaMA3-8BVariant=LoRA-Drop, drop-ratio (rho)=0.5, temporal window (k)=32026.01 | 40.8 | 68.7 | |
| Qwen2.5-7BVariant=Baseline2026.01 | 39 | 67.5 | |
| Qwen2.5-7BVariant=LoRA-Drop, drop-ratio (rho)=0.5, temporal window (k)=32026.01 | 38.8 | 67.2 | |
| LLaMA2-7BVariant=Baseline2026.01 | 37 | 65 | |
| LLaMA2-7BVariant=LoRA-Drop, drop-ratio (rho)=0.5, temporal window (k)=32026.01 | 36.8 | 64.7 |