Code Generation on LiveCodeBench (LCB) (Accuracy)
99.1AccuracyGemma4-26B
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemma4-26BDeployment=Local model2026.05 | 99.1 | |
| Best LocalConfig=Oracle local routing frontier2026.05 | 99.1 | |
| Claude Opus 4.6Deployment=Cloud baseline2026.05 | 93.9 | |
| Gemini 3.1 ProDeployment=Cloud baseline2026.05 | 80 | |
| Qwen3.5-122BDeployment=Local model2026.05 | 78.6 | |
| GPT 5.4Deployment=Cloud baseline2026.05 | 70 | |
| Gemma4-E4BDeployment=Local model2026.05 | 68.3 | |
| Qwen3.5-35BDeployment=Local model2026.05 | 61.5 | |
| Qwen3.5-27BDeployment=Local model2026.05 | 51 | |
| Qwen3.5-9BDeployment=Local model2026.05 | 48.5 | |
| Nemotron-Super-120BDeployment=Local model2026.05 | 47.3 | |
| DelTA2026.05 | 35.6 | |
| DAPO2026.05 | 33.4 | |
| ExPODistillation Setting=Multi-Teacher Distillation2026.02 | 29 | |
| ExOPDDistillation Setting=Multi-Teacher Distillation2026.02 | 29 | |
| ExOPDDistillation Setting=Single-Teacher Distillation2026.02 | 28.6 | |
| ExPODistillation Setting=Single-Teacher Distillation2026.02 | 28 | |
| OPDDistillation Setting=Multi-Teacher Distillation2026.02 | 27.6 | |
| TeacherDistillation Setting=Baseline2026.02 | 27.3 | |
| OPDDistillation Setting=Single-Teacher Distillation2026.02 | 27.3 | |
| SFTDistillation Setting=Multi-Teacher Distillation2026.02 | 26.4 | |
| Granite 4.0 H-SmallDeployment=Local model2026.05 | 26.3 | |
| StudentDistillation Setting=Baseline2026.02 | 17.9 | |
| Granite 3.3 8BDeployment=Local model2026.05 | 5.3 |