Hallucination prediction on Mintaka refined by question type and domain
75.51AUROCConf (SCAO)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Conf (SCAO)Model Size=8B, SCAO=true2025.09 | 75.51 | — | |
| Conf (SCAO)Model Size=8B2025.09 | 75.51 | — | |
| Conf + Probe (SCAO)Model Size=8B, SCAO=true2025.09 | 74.89 | 13.27 | |
| Conf + Probe (SCAO)Model Size=8B2025.09 | 74.89 | 13.27 | |
| Conf + Probe (SCAO)Model Size=70B, SCAO=true2025.09 | 72.89 | 14.12 | |
| Conf + Probe (SCAO)Model Size=70B2025.09 | 72.89 | 14.12 | |
| Probe_dnnModel Size=8B2025.09 | 72.79 | 11.17 | |
| Probe_dnnModel Size=8B2025.09 | 72.79 | 11.17 | |
| Conf (SCAO)Model Size=70B, SCAO=true2025.09 | 72.46 | — | |
| Conf (SCAO)Model Size=70B2025.09 | 72.46 | — | |
| Probe_dnnModel Size=70B2025.09 | 71.03 | 12.26 | |
| Probe_dnnModel Size=70B2025.09 | 71.03 | 12.26 | |
| Conf + ProbeModel Size=70B2025.09 | 70.8 | 12.03 | |
| Conf + ProbeModel Size=70B2025.09 | 70.8 | 12.03 | |
| Conf + ProbeModel Size=8B2025.09 | 70.77 | 9.15 | |
| Conf + ProbeModel Size=8B2025.09 | 70.77 | 9.15 | |
| ConfModel Size=8B2025.09 | 69.23 | — | |
| ConfModel Size=8B2025.09 | 69.23 | — | |
| ConfModel Size=70B2025.09 | 66.35 | — | |
| ConfModel Size=70B2025.09 | 66.35 | — |