Coding on HumanEval (mean score)
0.9695HumanEval Mean ScoreMinistral-3-R
Evaluation Results
| Method | Links | |
|---|---|---|
| Ministral-3-R# Param.=8B2026.02 | 0.9695 | |
| Falcon-H1R# Param.=7B2026.02 | 0.9634 | |
| MiniCPM-SALA# Param.=9B2026.02 | 0.9512 | |
| Phi-42026.01 | 0.945 | |
| Qwen3# Param.=8B2026.02 | 0.939 | |
| Nemotron-Nano-v2# Param.=9B2026.02 | 0.939 | |
| Llama-3.3-70B-InstructParameters=70B2026.01 | 0.933 | |
| MiniCPM-4.1# Param.=8B2026.02 | 0.9146 | |
| Llama-3.1-8B-InstructParameters=8B2026.01 | 0.823 | |
| Foundation-Sec-8B-InstructParameters=8B2026.01 | 0.823 | |
| Llama-Primus-Merged2026.01 | 0.817 | |
| Foundation-Sec-8B-ReasoningParameters=8B2026.01 | 0.799 | |
| Qwen2.5-7B-InstBase=Base, Verifier=-2026.01 | 0.793 | |
| DARLBase=Base, Verifier=✗2026.01 | 0.75 | |
| VeriFreeBase=Base, Verifier=✗2026.01 | 0.72 | |
| RLVRBase=Base, Verifier=Rule2026.01 | 0.689 | |
| SimpleRL-ZooBase=Base, Verifier=Rule2026.01 | 0.671 | |
| DARLBase=Inst, Verifier=✗2026.01 | 0.64 | |
| RLPRBase=Inst, Verifier=✗2026.01 | 0.634 | |
| Llama3.1-8B-InstBase=Inst, Verifier=-2026.01 | 0.616 | |
| General ReasonerBase=Base, Verifier=Model2026.01 | 0.616 | |
| Oat-ZeroBase=Math, Verifier=Rule2026.01 | 0.61 | |
| SimpleRL-ZooBase=Math, Verifier=Rule2026.01 | 0.61 | |
| RLPRBase=Base, Verifier=✗2026.01 | 0.567 | |
| TTRLBase=Base, Verifier=Rule2026.01 | 0.506 | |
| MobileLLM-FlashNumber of Parameters=1.4B, Instruction Fine-Tuning (IFT)=true, Evaluation Protocol=user-assistant conversations2026.03 | 0.4634 | |
| MobileLLM-FlashNumber of Parameters=650M, Instruction Fine-Tuning (IFT)=true, Evaluation Protocol=user-assistant conversations2026.03 | 0.4512 | |
| Gemma3Number of Parameters=1B, Instruction Fine-Tuning (IFT)=true, Evaluation Protocol=user-assistant conversations2026.03 | 0.415 | |
| RLVRBase=Inst, Verifier=Rule2026.01 | 0.384 | |
| Qwen2.5-7BBase=-, Verifier=-2026.01 | 0.378 | |
| Llama3.2Number of Parameters=1B, Instruction Fine-Tuning (IFT)=true, Evaluation Protocol=user-assistant conversations2026.03 | 0.378 | |
| PRIMEBase=Math, Verifier=Rule2026.01 | 0.03 |