Code Generation on MBPP (Score)
89ScoreKimi-K2
Evaluation results
| Method | Links | |
|---|---|---|
| Kimi-K2Model Variant=Base, # Shots=3-shot, # Activated Params=32B, # Total Params=1043B2026.02 | 89 | |
| GLM-4.5Model Variant=Base, # Shots=3-shot, # Activated Params=32B, # Total Params=355B2026.02 | 81.6 | |
| MiMo-V2 FlashModel Variant=Base, # Shots=3-shot, # Activated Params=15B, # Total Params=309B2026.02 | 81 | |
| Step 3.5 FlashModel Variant=Base, # Shots=3-shot, # Activated Params=11B, # Total Params=196B2026.02 | 79.4 | |
| DeepSeek V3.2Model Variant=Exp Base, # Shots=3-shot, # Activated Params=37B, # Total Params=671B2026.02 | 75.6 | |
| DeepSeek V3.1Model Variant=Base, # Shots=3-shot, # Activated Params=37B, # Total Params=671B2026.02 | 74.6 |