Coding Reasoning on LiveCodeBench 2024.10-2025.02
58.46Pass@1FP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Model=Qwen3-8B, Quantization Bits=FP162026.05 | 58.46 | |
| FP16Model=Qwen3-4B, Quantization Bits=FP162026.05 | 54.48 | |
| LAQuantModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 51.74 | |
| ParoQ++Model=Qwen3-8B, Quantization Bits=3-bit2026.05 | 51.12 | |
| LAQuantModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 45.15 | |
| ParoQ++Model=Qwen3-4B, Quantization Bits=3-bit2026.05 | 45.03 | |
| ParoQModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 44.65 | |
| R-QATModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 44.16 | |
| ParoQModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 38.31 | |
| GPTQModel=Qwen3-8B, Quantization Bits=3-bit2026.05 | 37.94 | |
| R-QATModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 37.31 | |
| FP16Model=R1-Distill-Llama-8B, Quantization Bits=FP162026.05 | 36.32 | |
| FP16Model=Qwen3-1.7B, Quantization Bits=FP162026.05 | 33.71 | |
| LAQuantModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 31.22 | |
| ParoQ++Model=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 29.47 | |
| R-QATModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 29.11 | |
| GPTQModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 24.13 | |
| LAQuantModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 21.02 | |
| R-QATModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 19.9 | |
| ParoQ++Model=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 19.4 | |
| ParoQModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 12.94 | |
| GPTQModel=Qwen3-4B, Quantization Bits=3-bit2026.05 | 2.99 | |
| ParoQModel=R1-Distill-Llama-8B, Quantization Bits=3-bit2026.05 | 1.12 | |
| GPTQModel=Qwen3-1.7B, Quantization Bits=3-bit2026.05 | 0 |