# Hallucination Detection on SC-Vicuna (AUCPR)

Source: [Hallucination Detection on SC-Vicuna (AUCPR)](<https://www.sota2.com/research/sota/hallucination-detection-on-sc-vicuna-aucpr>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-08T06:36:52.902Z

Evaluation of model performance on hallucination detection using the SC-Vicuna dataset, specifically measured using AUCPR.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hallucination Detection |
| Dataset (including any stated split) | SC-Vicuna |
| Metric | AUCPR |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUCPR](<https://www.sota2.com/research/sota/hallucination-detection-on-sc-vicuna-aucpr.md?metric=AUCPR>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUCPR | Result date | Report paper |
| --- | --- | --- | --- |
| SELFCHECKGPT | 91.1 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 90.7 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 90.3 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 90.2 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 89.3 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 89.2 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 88.5 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 88.5 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 88.4 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SELFCHECKGPT | 88.4 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 88.1 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 87.9 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 87.7 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 87.5 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 86 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 84.9 | Not recorded | 68fa7a4a1e209131cea823a4 |
| DIRECT | 84.6 | Not recorded | 68fa7a4a1e209131cea823a4 |
| SC | 84.4 | Not recorded | 68fa7a4a1e209131cea823a4 |

### SELFCHECKGPT

AUCPR: 91.1. Result ID: 69d5f6e047f34ce924bdf837.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"true"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUCPR: 90.7. Result ID: 69d5f6e047f34ce924bdf83d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"true"}. This record does not assert independent reproduction.

### SC

AUCPR: 90.3. Result ID: 69d5f6e047f34ce924bdf839.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"true"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUCPR: 90.2. Result ID: 69d5f6e047f34ce924bdf836.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"false"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUCPR: 89.3. Result ID: 69d5f6e047f34ce924bdf83c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"false"}. This record does not assert independent reproduction.

### DIRECT

AUCPR: 89.2. Result ID: 69d5f6e047f34ce924bdf835.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"true"}. This record does not assert independent reproduction.

### SC

AUCPR: 88.5. Result ID: 69d5f6e047f34ce924bdf83f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"true"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUCPR: 88.5. Result ID: 69d5f6e047f34ce924bdf842.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"false"}. This record does not assert independent reproduction.

### DIRECT

AUCPR: 88.4. Result ID: 69d5f6e047f34ce924bdf834.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"false"}. This record does not assert independent reproduction.

### SELFCHECKGPT

AUCPR: 88.4. Result ID: 69d5f6e047f34ce924bdf843.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"true"}. This record does not assert independent reproduction.

### SC

AUCPR: 88.1. Result ID: 69d5f6e047f34ce924bdf838.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"false"}. This record does not assert independent reproduction.

### DIRECT

AUCPR: 87.9. Result ID: 69d5f6e047f34ce924bdf840.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"false"}. This record does not assert independent reproduction.

### DIRECT

AUCPR: 87.7. Result ID: 69d5f6e047f34ce924bdf841.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"true"}. This record does not assert independent reproduction.

### SC

AUCPR: 87.5. Result ID: 69d5f6e047f34ce924bdf83e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"false"}. This record does not assert independent reproduction.

### SC

AUCPR: 86. Result ID: 69d5f6e047f34ce924bdf845.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"true"}. This record does not assert independent reproduction.

### DIRECT

AUCPR: 84.9. Result ID: 69d5f6e047f34ce924bdf83b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"true"}. This record does not assert independent reproduction.

### DIRECT

AUCPR: 84.6. Result ID: 69d5f6e047f34ce924bdf83a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"false"}. This record does not assert independent reproduction.

### SC

AUCPR: 84.4. Result ID: 69d5f6e047f34ce924bdf844.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4a1e209131cea823a4.md>)

Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"false"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
