Code Generation on LiveCodeBench (LCB) (LCB)
20.79LCB ScoreGranite-3.3
Evaluation Results
| Method | Links | |
|---|---|---|
| Granite-3.3MT=MC, RL=MC2026.03 | 20.79 | |
| Granite-3.3MT=MC, RL=MCS2026.03 | 20.43 | |
| Granite-3.3MT=MCS, RL=MC2026.03 | 20.31 | |
| Granite-3.3MT=MCS, RL=MCS2026.03 | 17.2 | |
| Mistral-7BMT=MC, RL=MC2026.03 | 17.08 | |
| Mistral-7BMT=MC, RL=MCS2026.03 | 16.61 | |
| Mistral-7BMT=MCS, RL=MC2026.03 | 16.61 | |
| Mistral-7BMT=MCS, RL=MCS2026.03 | 16.01 | |
| LLaMA-3.1MT=MCS, RL=MCS2026.03 | 14.34 | |
| LLaMA-3.1MT=MCS, RL=MC2026.03 | 13.62 | |
| LLaMA-3.1MT=MC, RL=MC2026.03 | 12.31 | |
| LLaMA-3.1MT=MC, RL=MCS2026.03 | 11.83 | |
| Granite-3.3MT=MC, RL=–2026.03 | 11.11 | |
| Mistral-7BMT=MC, RL=–2026.03 | 11.11 | |
| Granite-3.3MT=MCS, RL=–2026.03 | 10.63 | |
| Mistral-7BMT=MCS, RL=–2026.03 | 10.16 | |
| LLaMA-3.1MT=MC, RL=–2026.03 | 6.93 | |
| LLaMA-3.1MT=MCS, RL=–2026.03 | 6.09 | |
| Granite-3.3MT=–, RL=–2026.03 | 2.15 | |
| LLaMA-3.1MT=–, RL=–2026.03 | 0 | |
| Mistral-7BMT=–, RL=–2026.03 | 0 |