List your company
ResearchFormerly WizWand

Code Generation on CodeAlpaca 20k (NLL)

0.597NLLSPD
0.588520.645760.7030.76024May 21, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SPDBackbone=Qwen2.5-7B-Instruct2026.050.597
PSRBackbone=Qwen2.5-7B-Instruct2026.050.603
SSDBackbone=Qwen2.5-7B-Instruct2026.050.608
Base modelBackbone=Qwen2.5-7B-Instruct2026.050.653
SPDBackbone=Qwen2.5-0.5B-Instruct2026.050.679
SSDBackbone=Qwen2.5-0.5B-Instruct2026.050.682
Base modelBackbone=Qwen2.5-0.5B-Instruct2026.050.683
PSRBackbone=Qwen2.5-0.5B-Instruct2026.050.683
SPDBackbone=Qwen2.5-14B-Instruct2026.050.687
SSDBackbone=Qwen2.5-14B-Instruct2026.050.688
PSRBackbone=Qwen2.5-14B-Instruct2026.050.692
SPDBackbone=Llama-3.1-8B-Instruct2026.050.692
SSDBackbone=Llama-3.1-8B-Instruct2026.050.729
Base modelBackbone=Qwen2.5-14B-Instruct2026.050.737
SPDBackbone=Qwen3-4B-Instruct2026.050.745
Base modelBackbone=Llama-3.1-8B-Instruct2026.050.751
PSRBackbone=Qwen3-4B-Instruct2026.050.752
SSDBackbone=Qwen3-4B-Instruct2026.050.754
PSRBackbone=Llama-3.1-8B-Instruct2026.050.786
Base modelBackbone=Qwen3-4B-Instruct2026.050.809