# Hallucination Detection on SC-LLaMA

Source: [Hallucination Detection on SC-LLaMA](<https://www.sota2.com/research/sota/hallucination-detection-on-sc-llama>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T06:36:52.704Z

Evaluation of model performance on Hallucination Detection using the SC-LLaMA dataset, measured by AUROC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hallucination Detection |
| Dataset (including any stated split) | SC-LLaMA |
| Metric | AUROC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUROC](<https://www.sota2.com/research/sota/hallucination-detection-on-sc-llama.md?metric=AUROC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUROC | Result date | Report paper |
| --- | --- | --- | --- |
| SC+f | 71.2 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT+f | 71.2 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT+f | 69.8 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 68.7 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 68.1 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT+f | 67.1 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 67.1 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT+f | 67 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC+f | 66.2 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 65.9 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT+f | 65.4 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 64.8 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 64.2 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 63.5 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC+f | 60 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT+f | 58.1 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 55.6 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 52.3 | Not recorded | 68fa7a4a1e209131cea823a4 |

### SC+f

AUROC: 71.2. Result ID: 69d5f6e047f34ce924bdf7cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future Context":"true"}. This record does not assert independent reproduction.

### SELFCHECKGPT+f

AUROC: 71.2. Result ID: 69d5f6e047f34ce924bdf7d1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future Context":"true"}. This record does not assert independent reproduction.

### SELFCHECKGPT+f

AUROC: 69.8. Result ID: 69d5f6e047f34ce924bdf7cb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future Context":"true"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUROC: 68.7. Result ID: 69d5f6e047f34ce924bdf7d0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future Context":"false"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUROC: 68.1. Result ID: 69d5f6e047f34ce924bdf7ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future Context":"false"}. This record does not assert independent reproduction.

### DIRECT+f

AUROC: 67.1. Result ID: 69d5f6e047f34ce924bdf7c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future Context":"true"}. This record does not assert independent reproduction.

### SC

AUROC: 67.1. Result ID: 69d5f6e047f34ce924bdf7cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future Context":"false"}. This record does not assert independent reproduction.

### DIRECT+f

AUROC: 67. Result ID: 69d5f6e047f34ce924bdf7d5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future Context":"true"}. This record does not assert independent reproduction.

### SC+f

AUROC: 66.2. Result ID: 69d5f6e047f34ce924bdf7d3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future Context":"true"}. This record does not assert independent reproduction.

### DIRECT

AUROC: 65.9. Result ID: 69d5f6e047f34ce924bdf7c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future Context":"false"}. This record does not assert independent reproduction.

### SELFCHECKGPT+f

AUROC: 65.4. Result ID: 69d5f6e047f34ce924bdf7d7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future Context":"true"}. This record does not assert independent reproduction.

### DIRECT

AUROC: 64.8. Result ID: 69d5f6e047f34ce924bdf7d4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future Context":"false"}. This record does not assert independent reproduction.

### SC

AUROC: 64.2. Result ID: 69d5f6e047f34ce924bdf7d2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future Context":"false"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUROC: 63.5. Result ID: 69d5f6e047f34ce924bdf7d6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future Context":"false"}. This record does not assert independent reproduction.

### SC+f

AUROC: 60. Result ID: 69d5f6e047f34ce924bdf7d9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future Context":"true"}. This record does not assert independent reproduction.

### DIRECT+f

AUROC: 58.1. Result ID: 69d5f6e047f34ce924bdf7cf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future Context":"true"}. This record does not assert independent reproduction.

### DIRECT

AUROC: 55.6. Result ID: 69d5f6e047f34ce924bdf7ce.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future Context":"false"}. This record does not assert independent reproduction.

### SC

AUROC: 52.3. Result ID: 69d5f6e047f34ce924bdf7d8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future Context":"false"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
