Hallucination Detection on Custom Dataset
72.9F1 ScoreEnsemble+ML
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ensemble+ML2026.03 | 72.9 | 73.5 | 74.8 | 72.4 | |
| Binary Logits2026.03 | 72.7 | 75.8 | 81.5 | 66.3 | |
| Features+ML2026.03 | 71.7 | 75.1 | 76.7 | 67.3 | |
| Rule-Based (OR)2026.03 | 71.7 | — | — | — | |
| Rule-Based (AND)2026.03 | 68.9 | — | — | — | |
| Non-LLM Baseline2026.03 | 66.1 | 67.2 | 69.1 | 64.4 | |
| Adversarial2026.03 | 52 | — | — | — | |
| DSPy MIPRO2026.03 | 45.3 | 77.5 | 80 | 33.3 | |
| DSPy Baseline2026.03 | 40 | 75.6 | 80 | 28.3 | |
| RefChecker2026.03 | 27.1 | 45.1 | 22.7 | 35.4 | |
| SelfCheckGPT2026.03 | 26.5 | 52.3 | 57.6 | 17.2 | |
| GPT-4o-mini2026.03 | 16.9 | 54.6 | 100 | 9.3 | |
| GPT-52026.03 | 15.8 | 93.6 | 14.6 | 15.4 | |
| O32026.03 | 8.9 | 94.3 | 10.7 | 7.6 | |
| SAC3Backbone=L3.3-70B2026.03 | 0 | 90 | 0 | 0 |