List your company
ResearchFormerly WizWand

Code Generation on HumanEval (ΔPPL)

14.8ΔPPL (%)CE
-1.4242.788711.212May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
CEBackbone=0.5B, Adapter=DoRA2026.0514.8
CEBackbone=0.5B, Adapter=LoRA2026.0514.3
CEBackbone=0.5B, Adapter=SineLoRA2026.0513.9
CEBackbone=7B, Adapter=LoRA2026.0512.8
CEBackbone=7B, Adapter=DoRA2026.0512.5
CEBackbone=7B, Adapter=SineLoRA2026.0512.1
CEBackbone=0.5B, Adapter=RandLoRA2026.0510.5
CEBackbone=7B, Adapter=RandLoRA2026.059.5
BaseBackbone=0.5B2026.055.12
BaseBackbone=7B2026.053.45
CE + TMKLBackbone=0.5B, Adapter=LoRA2026.050.8
CE + TMKLBackbone=0.5B, Adapter=DoRA2026.050.7
CE + TMKLBackbone=0.5B, Adapter=SineLoRA2026.050.5
CE + TMKLBackbone=0.5B, Adapter=RandLoRA2026.050.2
CE + TMKLBackbone=7B, Adapter=RandLoRA2026.050.1
CE + TMKLBackbone=7B, Adapter=SineLoRA2026.05-0.5
CE + TMKLBackbone=7B, Adapter=DoRA2026.05-0.6
CE + TMKLBackbone=7B, Adapter=LoRA2026.05-0.8