List your company
ResearchFormerly WizWand

Coding Reasoning on LiveCodeBench 2024.10-2025.02

58.46Pass@1FP16
-2.338413.445829.2345.0142May 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
FP16Model=Qwen3-8B, Quantization Bits=FP162026.0558.46
FP16Model=Qwen3-4B, Quantization Bits=FP162026.0554.48
LAQuantModel=Qwen3-8B, Quantization Bits=3-bit2026.0551.74
ParoQ++Model=Qwen3-8B, Quantization Bits=3-bit2026.0551.12
LAQuantModel=Qwen3-4B, Quantization Bits=3-bit2026.0545.15
ParoQ++Model=Qwen3-4B, Quantization Bits=3-bit2026.0545.03
ParoQModel=Qwen3-8B, Quantization Bits=3-bit2026.0544.65
R-QATModel=Qwen3-8B, Quantization Bits=3-bit2026.0544.16
ParoQModel=Qwen3-4B, Quantization Bits=3-bit2026.0538.31
GPTQModel=Qwen3-8B, Quantization Bits=3-bit2026.0537.94
R-QATModel=Qwen3-4B, Quantization Bits=3-bit2026.0537.31
FP16Model=R1-Distill-Llama-8B, Quantization Bits=FP162026.0536.32
FP16Model=Qwen3-1.7B, Quantization Bits=FP162026.0533.71
LAQuantModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.0531.22
ParoQ++Model=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.0529.47
R-QATModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.0529.11
GPTQModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.0524.13
LAQuantModel=Qwen3-1.7B, Quantization Bits=3-bit2026.0521.02
R-QATModel=Qwen3-1.7B, Quantization Bits=3-bit2026.0519.9
ParoQ++Model=Qwen3-1.7B, Quantization Bits=3-bit2026.0519.4
ParoQModel=Qwen3-1.7B, Quantization Bits=3-bit2026.0512.94
GPTQModel=Qwen3-4B, Quantization Bits=3-bit2026.052.99
ParoQModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.051.12
GPTQModel=Qwen3-1.7B, Quantization Bits=3-bit2026.050