Code Generation on LCB 2408-2505
74.6Pass@1Nemotron-Cascade 14B-Thinking
Evaluation results
| Method | Links | |
|---|---|---|
| Nemotron-Cascade 14B-ThinkingParameters=14B, Thinking Mode=true2025.12 | 74.6 | |
| DeepSeek-R1 0528 671BParameters=671B, Thinking Mode=true2025.12 | 73.3 | |
| Nemotron Cascade-8BParameters=8B, Thinking Mode=true2025.12 | 71.1 | |
| Nemotron-Nano 9B-v2Parameters=9B-v22025.12 | 65.3 | |
| Qwen3 14BParameters=14B2025.12 | 63.5 | |
| Gemini-2.5 Flash-ThinkingThinking Mode=true2025.12 | 61.9 | |
| DeepSeek V3.2Evaluation Mode=Chat2025.12 | 59.5 | |
| Qwen3 8BParameters=8B2025.12 | 58.3 | |
| LongCat-Flash Exp-ChatEvaluation Mode=Chat2025.12 | 56.6 | |
| GLM 4.6Evaluation Mode=Chat2025.12 | 56.4 | |
| LongCat-Flash ChatEvaluation Mode=Chat2025.12 | 48 |