Hallucination Detection on RAGTruth RT-Summ 1.0 (test)
0.6966F1 ScoreSelfcheckGPT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SelfcheckGPTModel=Mistral-7B2026.02 | 0.6966 | 0.7166 | |
| Wavelet-highModel=Mistral-7B2026.02 | 0.6849 | 0.8075 | |
| Fourier-highModel=Mistral-7B2026.02 | 0.6761 | 0.8037 | |
| Lookback-lensModel=Mistral-7B2026.02 | 0.6759 | 0.7954 | |
| LaplacianModel=Mistral-7B2026.02 | 0.6723 | 0.7978 | |
| RefCheckerModel=Mistral-7B2026.02 | 0.6664 | 0.6596 | |
| Attn-entropyModel=Mistral-7B2026.02 | 0.6551 | 0.7867 | |
| SelfcheckGPTModel=LLaMA-7B2026.02 | 0.6349 | 0.6674 | |
| RefCheckerModel=LLaMA-7B2026.02 | 0.6059 | 0.608 | |
| Wavelet-highModel=LLaMA-7B2026.02 | 0.5929 | 0.7165 | |
| Fourier-highModel=LLaMA-13B2026.02 | 0.5929 | 0.7362 | |
| RefCheckerModel=LLaMA-13B2026.02 | 0.5924 | 0.6346 | |
| RedeepModel=LLaMA-7B2026.02 | 0.5897 | 0.576 | |
| Fourier-highModel=LLaMA-7B2026.02 | 0.5875 | 0.7426 | |
| LaplacianModel=LLaMA-7B2026.02 | 0.5779 | 0.704 | |
| Lookback-lensModel=LLaMA-13B2026.02 | 0.5679 | 0.6702 | |
| Wavelet-highModel=LLaMA-13B2026.02 | 0.5651 | 0.7042 | |
| SelfcheckGPTModel=LLaMA-13B2026.02 | 0.5554 | 0.5909 | |
| LaplacianModel=LLaMA-13B2026.02 | 0.5548 | 0.67 | |
| Attn-entropyModel=LLaMA-13B2026.02 | 0.5527 | 0.6865 | |
| RedeepModel=Mistral-7B2026.02 | 0.5379 | 0.568 | |
| Lookback-lensModel=LLaMA-7B2026.02 | 0.5328 | 0.7156 | |
| EigenScoreModel=LLaMA-13B2026.02 | 0.5121 | 0.5097 | |
| EigenScoreModel=LLaMA-7B2026.02 | 0.5065 | 0.4989 | |
| Attn-entropyModel=LLaMA-7B2026.02 | 0.5031 | 0.6722 | |
| RedeepModel=LLaMA-13B2026.02 | 0.501 | 0.5253 | |
| Attn-varianceModel=LLaMA-13B2026.02 | 0.4947 | 0.6629 | |
| Attn-varianceModel=LLaMA-7B2026.02 | 0.4886 | 0.6492 | |
| Attn-varianceModel=Mistral-7B2026.02 | 0.484 | 0.5836 | |
| EigenScoreModel=Mistral-7B2026.02 | 0.4582 | 0.4973 |