Coding on CRUXEval
88.5Pass@1JT-Safe-V2-35B
Evaluation results
| Method | Links | |
|---|---|---|
| JT-Safe-V2-35BParameters=35B2026.05 | 88.5 | |
| SOTA with Equivalent ParametersModel comparison=Equivalent Parameters2026.05 | 75.7 | |
| Youtu-LLMSize=2B, Type=Base, Prompt Setting=1-shot2025.12 | 55.9 | |
| Qwen3Size=4B, Type=Base, Prompt Setting=1-shot2025.12 | 54.8 | |
| Llama3.1Size=8B, Type=Base, Prompt Setting=1-shot2025.12 | 42.3 | |
| SmolLM3Size=3B, Type=Base, Prompt Setting=1-shot2025.12 | 42.1 | |
| Qwen3Size=1.7B, Type=Base, Prompt Setting=1-shot2025.12 | 40.6 | |
| Gemma3Size=4B, Type=Base, Prompt Setting=1-shot2025.12 | 39.7 |