Failure Diagnosis on TruthfulQA
38Macro Similarity TypePROBELLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PROBELLMTarget Model=Mistral-7B-Ins., Model Family=Mistral Family, Release Date=May 20242026.02 | 38 | 62 | 77 | 78 | 20 | |
| PROBELLMTarget Model=GPT-4o-mini, Model Family=OpenAI Family, Release Date=Jul 20242026.02 | 29 | 71 | 57 | 63 | 10 | |
| PROBELLMTarget Model=Ministral-8B, Model Family=Mistral Family, Release Date=Oct 20242026.02 | 24 | 76 | 72 | 74 | 19 | |
| PROBELLMTarget Model=GPT-4.1, Model Family=OpenAI Family, Release Date=Apr 20252026.02 | 23 | 77 | 47 | 36 | 6 | |
| PROBELLMTarget Model=GPT-5.2, Model Family=OpenAI Family, Release Date=Dec 20252026.02 | 23 | 77 | 41 | 29 | 5 | |
| PROBELLMTarget Model=GPT-3.5-turbo, Model Family=OpenAI Family, Release Date=Mar 20232026.02 | 22 | 78 | 67 | 75 | 16 | |
| PROBELLMTarget Model=Ministral-3-8B-2512, Model Family=Mistral Family, Release Date=Dec 20252026.02 | 22 | 78 | 60 | 57 | 16 | |
| PROBELLMTarget Model=Mistral-7B-Ins.-v0.1, Model Family=Mistral Family, Release Date=Sep 20232026.02 | 21 | 79 | 82 | 81 | 16 |