Code Generation on MBPP (% Quality, Cost ($), % Error Rate Reduction) benchmark leaderboard · SOTA2 Research

Code Generation on MBPP (% Quality, Cost ($), % Error Rate Reduction)

93.4Quality (%)Okshot

Evaluation Results

Method	Links
Okshot2026.06		93.4	0.029	51.8
SOTA LLM2026.06		86.2	0.001	—