Hallucination Detection on HaluEval, HotpotQA, TriviaQA, and SQuAD
99.05HaluEval ScoreHARP
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| HARPBackbone=Qwen-3-8B-it, Train dataset=HaluEval2026.06 | 99.05 | 82.75 | 84.5 | 59.35 | 81.41 | 0.0202 | |
| HARPBackbone=Llama-3-8B-it, Train dataset=HaluEval2026.06 | 98.7 | 56.9 | 56.35 | 56.15 | 67.03 | 0.0335 | |
| HARPBackbone=Gemma3-12B-it, Train dataset=HaluEval2026.06 | 98.7 | 87.55 | 87.85 | 66.45 | 85.14 | 0.0137 | |
| HARPBackbone=Ministral3-8B-Base, Train dataset=HaluEval2026.06 | 98.5 | 68.35 | 66.21 | 53.5 | 71.64 | 0.0273 | |
| AURORABackbone=Gemma3-12B-it, Train dataset=HaluEval2026.06 | 97.8 | 89.1 | 92.5 | 81.35 | 90.19 | 0.0036 | |
| AURORABackbone=Ministral3-8B-Base, Train dataset=HaluEval2026.06 | 96.95 | 85 | 92.05 | 69.75 | 85.94 | 0.0105 | |
| AURORABackbone=Llama-3-8B-it, Train dataset=HaluEval2026.06 | 96.15 | 76.1 | 83.4 | 65.4 | 80.26 | 0.0125 | |
| ICRBackbone=Ministral3-8B-Base, Train dataset=HaluEval2026.06 | 95.9 | 61.7 | 59.45 | 51.5 | 67.14 | 0.029 | |
| AURORABackbone=Qwen-3-8B-it, Train dataset=HaluEval2026.06 | 95.05 | 83.05 | 89.1 | 68.15 | 83.84 | 0.01 | |
| HARPBackbone=Qwen-3-8B-it, Train dataset=SQuAD2026.06 | 90.45 | 88.25 | 94.45 | 87.2 | 90.09 | 0.0008 | |
| HARPBackbone=Ministral3-8B-Base, Train dataset=SQuAD2026.06 | 87.65 | 70.85 | 85.46 | 89.75 | 83.43 | 0.0055 | |
| HARPBackbone=Gemma3-12B-it, Train dataset=SQuAD2026.06 | 83.1 | 87.5 | 92.05 | 91.7 | 88.59 | 0.0013 | |
| AURORABackbone=Gemma3-12B-it, Train dataset=SQuAD2026.06 | 83 | 88.55 | 93.25 | 91 | 88.95 | 0.0015 | |
| HARPBackbone=Ministral3-8B-Base, Train dataset=TriviaQA2026.06 | 81.25 | 89.45 | 92.76 | 61.7 | 81.29 | 0.0145 | |
| AURORABackbone=Qwen-3-8B-it, Train dataset=SQuAD2026.06 | 80.5 | 85.8 | 91 | 83.35 | 85.16 | 0.0015 | |
| HARPBackbone=Ministral3-8B-Base, Train dataset=HotpotQA2026.06 | 80.45 | 91.9 | 91.85 | 64 | 82.05 | 0.013 | |
| AURORABackbone=Gemma3-12B-it, Train dataset=HotpotQA2026.06 | 80 | 94.8 | 98.95 | 82 | 88.94 | 0.0066 | |
| HARPBackbone=Llama-3-8B-it, Train dataset=SQuAD2026.06 | 77.9 | 67.65 | 73.3 | 85.4 | 76.06 | 0.0042 | |
| ICRBackbone=Qwen-3-8B-it, Train dataset=SQuAD2026.06 | 77.85 | 58.4 | 60.75 | 66 | 65.75 | 0.0056 | |
| AURORABackbone=Qwen-3-8B-it, Train dataset=TriviaQA2026.06 | 76.8 | 93.9 | 97.8 | 69.6 | 84.53 | 0.0137 | |
| AURORABackbone=Gemma3-12B-it, Train dataset=HotpotQA2026.06 | 75 | 97.95 | 98.35 | 83.85 | 88.79 | 0.0097 | |
| AURORABackbone=Ministral3-8B-Base, Train dataset=SQuAD2026.06 | 74.35 | 84.95 | 90.7 | 83.95 | 83.49 | 0.0034 | |
| AURORABackbone=Llama-3-8B-it, Train dataset=SQuAD2026.06 | 72.85 | 74.15 | 79.15 | 84.05 | 77.55 | 0.002 | |
| HARPBackbone=Llama-3-8B-it, Train dataset=TriviaQA2026.06 | 72 | 82.5 | 90.95 | 59.35 | 76.2 | 0.014 | |
| HARPBackbone=Gemma3-12B-it, Train dataset=HotpotQA2026.06 | 69.75 | 95.3 | 98 | 78.85 | 85.48 | 0.0136 | |
| HARPBackbone=Qwen-3-8B-it, Train dataset=HotpotQA2026.06 | 68.65 | 98.05 | 98.85 | 62.1 | 81.91 | 0.0279 | |
| HARPBackbone=Qwen-3-8B-it, Train dataset=TriviaQA2026.06 | 67.55 | 96.25 | 98.95 | 63.75 | 81.63 | 0.0258 | |
| AURORABackbone=Ministral3-8B-Base, Train dataset=HotpotQA2026.06 | 67.3 | 97.75 | 97.6 | 69.55 | 83.05 | 0.0215 | |
| AURORABackbone=Ministral3-8B-Base, Train dataset=TriviaQA2026.06 | 66.8 | 94.8 | 98.3 | 72.85 | 83.19 | 0.0185 | |
| HARPBackbone=Llama-3-8B-it, Train dataset=HotpotQA2026.06 | 64.7 | 96.7 | 97.2 | 60.9 | 79.88 | 0.0293 | |
| AURORABackbone=Qwen-3-8B-it, Train dataset=HotpotQA2026.06 | 64.6 | 96.6 | 96.8 | 70.8 | 82.2 | 0.0215 | |
| HARPBackbone=Gemma3-12B-it, Train dataset=HotpotQA2026.06 | 63.35 | 95.65 | 95.65 | 77.35 | 83 | 0.0185 | |
| ICRBackbone=Gemma3-12B-it, Train dataset=HotpotQA2026.06 | 62.15 | 95.95 | 97.1 | 51.25 | 76.61 | 0.0412 | |
| AURORABackbone=Llama-3-8B-it, Train dataset=TriviaQA2026.06 | 58.5 | 94.5 | 97.95 | 64.8 | 78.94 | 0.0305 | |
| ICRBackbone=Llama-3-8B-it, Train dataset=SQuAD2026.06 | 56.65 | 71.85 | 71.8 | 75.75 | 69.01 | 0.0054 | |
| AURORABackbone=Llama-3-8B-it, Train dataset=HotpotQA2026.06 | 56.25 | 96.2 | 96.7 | 63.75 | 78.23 | 0.0339 |