Code Generation on Codeforces (CF)
20.46CF ScoreGranite-3.3
Evaluation Results
| Method | Links | |
|---|---|---|
| Granite-3.3MT=MCS, RL=MC2026.03 | 20.46 | |
| Granite-3.3MT=MC, RL=MCS2026.03 | 19.57 | |
| Granite-3.3MT=MC, RL=MC2026.03 | 18.76 | |
| Granite-3.3MT=MCS, RL=MCS2026.03 | 18.03 | |
| Mistral-7BMT=MC, RL=MC2026.03 | 16.34 | |
| Mistral-7BMT=MC, RL=MCS2026.03 | 15.6 | |
| Mistral-7BMT=MCS, RL=MC2026.03 | 15.31 | |
| Mistral-7BMT=MCS, RL=MCS2026.03 | 15.16 | |
| LLaMA-3.1MT=MC, RL=MCS2026.03 | 12.8 | |
| LLaMA-3.1MT=MCS, RL=MCS2026.03 | 12.07 | |
| LLaMA-3.1MT=MC, RL=MC2026.03 | 11.85 | |
| LLaMA-3.1MT=MCS, RL=MC2026.03 | 11.41 | |
| Granite-3.3MT=MCS, RL=–2026.03 | 10.52 | |
| Granite-3.3MT=MC, RL=–2026.03 | 10.3 | |
| Mistral-7BMT=MCS, RL=–2026.03 | 9.42 | |
| Mistral-7BMT=MC, RL=–2026.03 | 9.27 | |
| LLaMA-3.1MT=MC, RL=–2026.03 | 6.03 | |
| LLaMA-3.1MT=MCS, RL=–2026.03 | 5.45 | |
| Granite-3.3MT=–, RL=–2026.03 | 1.99 | |
| Mistral-7BMT=–, RL=–2026.03 | 0.15 | |
| LLaMA-3.1MT=–, RL=–2026.03 | 0.07 |