Hallucination detection on VOXPOPULI (test)
2.03Hallucination Rate (%)RAUQ Entropy
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RAUQ EntropyModel=Voxtral-3B, Category=Baseline2026.04 | 2.03 | 96 | 35 | 47 | 28 | 32 | 43 | |
| Mean EntropyModel=Voxtral-3B, Category=Baseline2026.04 | 2.1 | 97 | 42 | 55 | 34 | 44 | 43 | |
| Logistic RegressionModel=Voxtral-3B, Feature Configuration=Top 75, Number of features=3002026.04 | 2.99 | 98 | 62 | 66 | 58 | 68 | 55 | |
| Logistic RegressionModel=Voxtral-3B, Feature Configuration=AUDIORATIO, Number of features=9602026.04 | 3.04 | 98 | 64 | 68 | 61 | 67 | 54 | |
| PerplexityModel=Voxtral-3B, Category=Baseline2026.04 | 3.12 | 96 | 40 | 42 | 39 | 41 | 40 | |
| Logistic RegressionModel=Voxtral-3B, Feature Configuration=Combined, Number of features=38402026.04 | 3.23 | 98 | 64 | 65 | 62 | 69 | 56 | |
| Attention ScoreModel=Voxtral-3B, Category=Baseline2026.04 | 7.12 | 91 | 17 | 12 | 26 | 9 | 10 | |
| RandomModel=Voxtral-3B, Category=Baseline2026.04 | 50.27 | 50 | 6 | 3 | 49 | — | — |