Code Generation on HumanEval (ΔPPL)
14.8ΔPPL (%)CE
Evaluation Results
| Method | Links | |
|---|---|---|
| CEBackbone=0.5B, Adapter=DoRA2026.05 | 14.8 | |
| CEBackbone=0.5B, Adapter=LoRA2026.05 | 14.3 | |
| CEBackbone=0.5B, Adapter=SineLoRA2026.05 | 13.9 | |
| CEBackbone=7B, Adapter=LoRA2026.05 | 12.8 | |
| CEBackbone=7B, Adapter=DoRA2026.05 | 12.5 | |
| CEBackbone=7B, Adapter=SineLoRA2026.05 | 12.1 | |
| CEBackbone=0.5B, Adapter=RandLoRA2026.05 | 10.5 | |
| CEBackbone=7B, Adapter=RandLoRA2026.05 | 9.5 | |
| BaseBackbone=0.5B2026.05 | 5.12 | |
| BaseBackbone=7B2026.05 | 3.45 | |
| CE + TMKLBackbone=0.5B, Adapter=LoRA2026.05 | 0.8 | |
| CE + TMKLBackbone=0.5B, Adapter=DoRA2026.05 | 0.7 | |
| CE + TMKLBackbone=0.5B, Adapter=SineLoRA2026.05 | 0.5 | |
| CE + TMKLBackbone=0.5B, Adapter=RandLoRA2026.05 | 0.2 | |
| CE + TMKLBackbone=7B, Adapter=RandLoRA2026.05 | 0.1 | |
| CE + TMKLBackbone=7B, Adapter=SineLoRA2026.05 | -0.5 | |
| CE + TMKLBackbone=7B, Adapter=DoRA2026.05 | -0.6 | |
| CE + TMKLBackbone=7B, Adapter=LoRA2026.05 | -0.8 |