Hallucination Detection on PopQA
96.18AUCPR
Evaluation results
| Method | Links | |
|---|---|---|
| PRModel=LLama-3.2-1B2026.01 | 96.18 | |
| MoPModel=LLama-3.2-1B2026.01 | 95.85 | |
| PRModel=LLama-3.2-3B2026.01 | 95.7 | |
| PRModel=Mistral-7B-v0.12026.01 | 94.72 | |
| Probing BaselineModel=LLama-3.2-1B2026.01 | 94.25 | |
| PRModel=LLama-3-8B2026.01 | 94.01 | |
| PRBackbone=Llama-3-8B2026.01 | 94.01 | |
| MoP-VanillaExpertsModel=LLama-3.2-1B2026.01 | 93.86 | |
| PRBackbone=Mistral-7B-v0.32026.01 | 93.09 | |
| PRModel=Mistral-7B-v0.32026.01 | 93.09 | |
| MoPModel=LLama-3.2-3B2026.01 | 92.74 | |
| MoPModel=Mistral-7B-v0.12026.01 | 92.44 | |
| MoPModel=LLama-3-8B2026.01 | 92.11 | |
| MoPBackbone=Llama-3-8B2026.01 | 92.11 | |
| MoPBackbone=Mistral-7B-v0.32026.01 | 91.66 | |
| MoPModel=Mistral-7B-v0.32026.01 | 91.66 | |
| MoP-VanillaExpertsModel=LLama-3.2-3B2026.01 | 90.98 | |
| Probing BaselineModel=LLama-3.2-3B2026.01 | 90.96 | |
| PRModel=LLama-3-70B2026.01 | 90.08 | |
| MoP-VanillaExpertsModel=Mistral-7B-v0.12026.01 | 89.82 | |
| Probing BaselineModel=Mistral-7B-v0.12026.01 | 89.61 | |
| MoP-VanillaExpertsModel=LLama-3-8B2026.01 | 89.11 | |
| MoP-VanillaExpertsBackbone=Llama-3-8B2026.01 | 89.11 | |
| Probing BaselineModel=LLama-3-8B2026.01 | 88.71 | |
| Probing BaselineBackbone=Llama-3-8B2026.01 | 88.71 | |
| MoPModel=LLama-3-70B2026.01 | 88.54 | |
| MoP-VanillaExpertsBackbone=Mistral-7B-v0.32026.01 | 88.53 | |
| MoP-VanillaExpertsModel=Mistral-7B-v0.32026.01 | 88.53 | |
| Probing BaselineBackbone=Mistral-7B-v0.32026.01 | 87.39 | |
| Probing BaselineModel=Mistral-7B-v0.32026.01 | 87.39 | |
| Logits-minBackbone=Mistral-7B-v0.32026.01 | 87.05 | |
| Logits-minModel=Mistral-7B-v0.32026.01 | 87.05 | |
| Probing BaselineModel=LLama-3-70B2026.01 | 86.88 | |
| MoP-VanillaExpertsModel=LLama-3-70B2026.01 | 86.04 | |
| Logits-minModel=Mistral-7B-v0.12026.01 | 86.02 | |
| Logits-minModel=LLama-3-8B2026.01 | 85.36 | |
| Logits-minBackbone=Llama-3-8B2026.01 | 85.36 | |
| MoP-RandomGateModel=LLama-3.2-1B2026.01 | 83.69 | |
| Logits-minModel=LLama-3.2-3B2026.01 | 80.92 | |
| MoP-RandomGateModel=Mistral-7B-v0.12026.01 | 80.5 | |
| Mean Token NegentropyModel=GPT-4o, Scorer Family=WB2026.06 | 80.2 | |
| Logits-minModel=LLama-3-70B2026.01 | 79.96 | |
| MoP-RandomGateBackbone=Mistral-7B-v0.32026.01 | 79.81 | |
| MoP-RandomGateModel=Mistral-7B-v0.32026.01 | 79.81 | |
| MoP-RandomGateModel=LLama-3.2-3B2026.01 | 79.69 | |
| Cosine SimilarityModel=Gemini-2.5, Scorer Family=BB2026.06 | 78.7 | |
| Logits-minModel=LLama-3.2-1B2026.01 | 78.66 | |
| Cosine SimilarityModel=GPT-4o, Scorer Family=BB2026.06 | 77.4 | |
| GPT-4oModel=Llama-3-8B, Scorer Family=Judge2026.06 | 77 | |
| MoP-RandomGateModel=LLama-3-8B2026.01 | 75.52 | |
| MoP-RandomGateBackbone=Llama-3-8B2026.01 | 75.52 | |
| Logits-meanModel=LLama-3.2-1B2026.01 | 74.89 | |
| Logits-meanModel=LLama-3-8B2026.01 | 74.52 | |
| Logits-meanBackbone=Llama-3-8B2026.01 | 74.52 | |
| LlamaModel=GPT-4o, Scorer Family=Judge2026.06 | 74.4 | |
| Logits-meanModel=LLama-3.2-3B2026.01 | 73.47 | |
| Scores-meanModel=LLama-3.2-1B2026.01 | 72.91 | |
| SonnetModel=Gemini-2.5, Scorer Family=Judge2026.06 | 72.8 | |
| Logits-meanBackbone=Mistral-7B-v0.32026.01 | 69.52 | |
| Logits-meanModel=Mistral-7B-v0.32026.01 | 69.52 | |
| P(True)Model=Llama-3-8B, Scorer Family=WB2026.06 | 69.5 | |
| Scores-maxModel=LLama-3.2-1B2026.01 | 69.33 | |
| Logits-meanModel=Mistral-7B-v0.12026.01 | 69.09 | |
| P(True)Model=Gemini-2.5, Scorer Family=WB2026.06 | 68.6 | |
| Scores-meanModel=LLama-3.2-3B2026.01 | 67.99 | |
| MoP-RandomGateModel=LLama-3-70B2026.01 | 67.96 | |
| Logits-meanModel=LLama-3-70B2026.01 | 67.81 | |
| Non-ContradictionModel=Llama-3-8B, Scorer Family=BB2026.06 | 66.6 | |
| Scores-minModel=LLama-3.2-1B2026.01 | 64.84 | |
| Scores-maxModel=LLama-3.2-3B2026.01 | 63.34 | |
| Scores-meanModel=LLama-3-8B2026.01 | 62.87 | |
| Scores-minModel=LLama-3.2-3B2026.01 | 61.51 | |
| Scores-minModel=LLama-3-8B2026.01 | 60.99 | |
| Scores-minModel=Mistral-7B-v0.32026.01 | 60.59 | |
| Scores-minModel=Mistral-7B-v0.12026.01 | 60 | |
| P(True)Model=LLama-3.2-1B2026.01 | 60 | |
| Scores-meanModel=Mistral-7B-v0.12026.01 | 59 | |
| Scores-meanModel=Mistral-7B-v0.32026.01 | 58.84 | |
| Scores-minModel=LLama-3-70B2026.01 | 58.77 | |
| Logits-maxModel=LLama-3.2-1B2026.01 | 58.56 | |
| Logits-maxModel=LLama-3-8B2026.01 | 58.08 | |
| Scores-meanModel=LLama-3-70B2026.01 | 56.81 | |
| Scores-maxModel=LLama-3-8B2026.01 | 56.62 | |
| Logits-maxModel=LLama-3-70B2026.01 | 56.21 | |
| Logits-maxModel=LLama-3.2-3B2026.01 | 56.03 | |
| P(True)Model=LLama-3-8B2026.01 | 55.85 | |
| P(True)Backbone=Llama-3-8B2026.01 | 55.85 | |
| Scores-maxModel=LLama-3-70B2026.01 | 55.15 | |
| P(True)Model=LLama-3-70B2026.01 | 54.83 | |
| P(True)Model=LLama-3.2-3B2026.01 | 54.58 | |
| Logits-maxModel=Mistral-7B-v0.12026.01 | 54.37 | |
| Logits-maxModel=Mistral-7B-v0.32026.01 | 54.34 | |
| Scores-maxModel=Mistral-7B-v0.32026.01 | 53 | |
| Scores-maxModel=Mistral-7B-v0.12026.01 | 51.71 | |
| P(True)Model=Mistral-7B-v0.12026.01 | 48.78 | |
| P(True)Backbone=Mistral-7B-v0.32026.01 | 45.49 | |
| P(True)Model=Mistral-7B-v0.32026.01 | 45.49 |