List your company

Failure Diagnosis on MBPP

50Macro Similarity ScorePROBELLM
11.5221.5131.541.49Feb 13, 2026

Evaluation results

MethodLinks
PROBELLMTarget Model=GPT-4.1, Model Family=OpenAI Family, Release Date=Apr 20252026.02505022366
PROBELLMTarget Model=GPT-5.2, Model Family=OpenAI Family, Release Date=Dec 20252026.02356525295
PROBELLMTarget Model=Ministral-8B, Model Family=Mistral Family, Release Date=Oct 20242026.023268777419
PROBELLMTarget Model=Mistral-7B-Ins.-v0.1, Model Family=Mistral Family, Release Date=Sep 20232026.023169828116
PROBELLMTarget Model=Ministral-3-8B-2512, Model Family=Mistral Family, Release Date=Dec 20252026.023169495716
PROBELLMTarget Model=GPT-3.5-turbo, Model Family=OpenAI Family, Release Date=Mar 20232026.022674807516
PROBELLMTarget Model=GPT-4o-mini, Model Family=OpenAI Family, Release Date=Jul 20242026.022080656310
PROBELLMTarget Model=Mistral-7B-Ins., Model Family=Mistral Family, Release Date=May 20242026.021387877820