List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench Jan-Apr 2025

47.25Accuracy (pass@1)BF16
11.255620.600329.94539.2897Dec 22, 2025
Updated 8mo ago

Evaluation results

MethodLinks
BF16Model=DeepSeek-R1-Distill-Qwen-32B, Bit-width=BF162025.1247.25
BF16Model=DeepSeek-R1-Distill-Qwen-14B, Bit-width=BF162025.1245.05
MixKVQModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=C2.32025.1245.05
KIVIModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=KV42025.1244.51
KVQuantModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=KV42025.1243.96
MixKVQModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=C2.32025.1243.41
RotateKVModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=KV42025.1242.86
KIVIModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=KV42025.1242.31
RotateKVModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=KV42025.1242.31
KVQuantModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=KV42025.1241.76
KVTunerModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=C2.912025.1241.76
KVTunerModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=C2.902025.1240.11
KIVIModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=KV22025.1239.56
BF16Model=DeepSeek-R1-Distill-Llama-8B, Bit-width=BF162025.1234.62
MixKVQModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=C2.72025.1231.87
KVTunerModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=C3.252025.1231.32
KIVIModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=KV22025.1231.32
RotateKVModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=KV42025.1230.22
KIVIModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=KV42025.1228.57
KVQuantModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=KV42025.1227.47
KVQuantModel=DeepSeek-R1-Distill-Qwen-32B, Bit-width=KV22025.1220.33
KIVIModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=KV22025.1217.58
KVQuantModel=DeepSeek-R1-Distill-Qwen-14B, Bit-width=KV22025.1214.29
KVQuantModel=DeepSeek-R1-Distill-Llama-8B, Bit-width=KV22025.1212.64