Hallucination prediction on Mintaka refined by question type
77.89AUROCConf + Probe (SCAO)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Conf + Probe (SCAO)Model Size=8B, SCAO=true2025.09 | 77.89 | 13.83 | |
| Conf + Probe (SCAO)Model Size=8B2025.09 | 77.89 | 13.83 | |
| Conf + ProbeModel Size=70B2025.09 | 77.68 | 13.33 | |
| Conf + ProbeModel Size=70B2025.09 | 77.68 | 13.33 | |
| Conf + ProbeModel Size=8B2025.09 | 77.54 | 13.48 | |
| Conf + ProbeModel Size=8B2025.09 | 77.54 | 13.48 | |
| Conf + Probe (SCAO)Model Size=70B, SCAO=true2025.09 | 77.22 | 12.87 | |
| Conf + Probe (SCAO)Model Size=70B2025.09 | 77.22 | 12.87 | |
| Probe_dnnModel Size=8B2025.09 | 75.7 | 11.64 | |
| Probe_dnnModel Size=8B2025.09 | 75.7 | 11.64 | |
| Probe_dnnModel Size=70B2025.09 | 75.54 | 10.19 | |
| Probe_dnnModel Size=70B2025.09 | 75.54 | 10.19 | |
| Conf (SCAO)Model Size=70B, SCAO=true2025.09 | 72.78 | — | |
| Conf (SCAO)Model Size=70B2025.09 | 72.78 | — | |
| Conf (SCAO)Model Size=8B, SCAO=true2025.09 | 72.01 | — | |
| Conf (SCAO)Model Size=8B2025.09 | 72.01 | — | |
| ConfModel Size=70B2025.09 | 67.16 | — | |
| ConfModel Size=70B2025.09 | 67.16 | — | |
| ConfModel Size=8B2025.09 | 64.61 | — | |
| ConfModel Size=8B2025.09 | 64.61 | — |