Code Generation on LiveCodeBench (LCB) V6 (Pass@1)
76.9Pass@1Nanbeige4.1-3B
Evaluation Results
| Method | Links | |
|---|---|---|
| Nanbeige4.1-3BParameters=3B2026.02 | 76.9 | |
| Qwen3-Next-80B-A3BParameters=80B2026.02 | 68.7 | |
| Qwen3-30B-A3B-2507Parameters=30B2026.02 | 66 | |
| Qwen3-4B-2507Parameters=4B2026.02 | 57.4 | |
| Qwen3-32BParameters=32B2026.02 | 55.7 | |
| VPDBackbone=Qwen3-8B, Thinking Mode=off2026.05 | 49.62 | |
| SDPO+RL (Joint Loss)Backbone=Qwen3-8B, Thinking Mode=off2026.05 | 47.52 | |
| SDPOBackbone=Qwen3-8B, Thinking Mode=off2026.05 | 47.33 | |
| SDPO+RL (Adv Reshape)Backbone=Qwen3-8B, Thinking Mode=off2026.05 | 46.95 | |
| Nanbeige4-3B-2511Parameters=3B2026.02 | 46 | |
| GRPOBackbone=Qwen3-8B, Thinking Mode=off2026.05 | 45.61 | |
| SDPO+RL (Adv Reweight)Backbone=Qwen3-8B, Thinking Mode=off2026.05 | 44.85 | |
| DMSModel=Qwen3-4B, Compression Ratio=75%2026.07 | 37 | |
| StreamLLMModel=Qwen3-4B, Compression Ratio=75%2026.07 | 36 | |
| TeacherModel=Qwen3-4B2026.07 | 35 | |
| KVPOP_mlpModel=Qwen3-4B, Compression Ratio=75%2026.07 | 35 | |
| StreamLLMModel=Qwen3-4B, Compression Ratio=88%2026.07 | 35 | |
| TOVAModel=Qwen3-4B, Compression Ratio=88%2026.07 | 35 | |
| DMSModel=Qwen3-4B, Compression Ratio=88%2026.07 | 35 | |
| KVPOP_mlpModel=Qwen3-4B, Compression Ratio=88%2026.07 | 35 | |
| TOVAModel=Qwen3-4B, Compression Ratio=75%2026.07 | 34 | |
| KVPOPModel=Qwen3-4B, Compression Ratio=88%2026.07 | 34 | |
| KVPOPModel=Qwen3-4B, Compression Ratio=75%2026.07 | 33 | |
| StreamLLM+Model=Qwen3-4B, Compression Ratio=75%2026.07 | 32 | |
| StreamLLM+Model=Qwen3-4B, Compression Ratio=88%2026.07 | 29 | |
| Qwen3-8BBackbone=Qwen3-8B, Thinking Mode=off2026.05 | 28.05 |