# Hallucination Detection on MetaQA 1hop (LLaMA2-7B)

Source: [Hallucination Detection on MetaQA 1hop (LLaMA2-7B)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-llama2-7b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:24:53.240Z

Evaluation of model performance on hallucination detection using the 1-hop subset of the MetaQA dataset, specifically focusing on results generated by LLaMA2-7B.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hallucination Detection |
| Dataset (including any stated split) | MetaQA 1hop (LLaMA2-7B) |
| Metric | AUC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 7 of 7 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-llama2-7b.md?metric=AUC>): Higher is better; unit: PERCENT.

- [F1 (class 1)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-llama2-7b.md?metric=F1%20(class%201)>): Higher is better; unit: PERCENT.

- [F1 (macro avg)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-llama2-7b.md?metric=F1%20(macro%20avg)>): Higher is better; unit: PERCENT.

- [Precision (class 1)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-llama2-7b.md?metric=Precision%20(class%201)>): Higher is better; unit: PERCENT.

- [Recall (class 1)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-llama2-7b.md?metric=Recall%20(class%201)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUC | Result date | Report paper |
| --- | --- | --- | --- |
| GGA (PRD + SAS) | 83.41 | Not recorded | 693a501f6cfd488761a54b4d |
| Embedding Divergence | 69.14 | Not recorded | 693a501f6cfd488761a54b4d |
| BERTScore | 63.66 | Not recorded | 693a501f6cfd488761a54b4d |
| NLI Contradiction | 57.41 | Not recorded | 693a501f6cfd488761a54b4d |
| Token confidence | 50.2 | Not recorded | 693a501f6cfd488761a54b4d |
| Max token probability | 50 | Not recorded | 693a501f6cfd488761a54b4d |
| Perplexity | 45.78 | Not recorded | 693a501f6cfd488761a54b4d |

### GGA (PRD + SAS)

AUC: 83.41. Result ID: 6996c5cd5698665ec4114a3a.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Our Method","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

### Embedding Divergence

AUC: 69.14. Result ID: 6996c5cd5698665ec4114a38.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Semantic Consistency","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

### BERTScore

AUC: 63.66. Result ID: 6996c5cd5698665ec4114a37.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67171e209131cea140d5.md>)

Recorded evaluation configuration: {"Category":"Semantic Consistency","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

### NLI Contradiction

AUC: 57.41. Result ID: 6996c5cd5698665ec4114a39.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62151e209131ce9f76f2.md>)

[Implementation](<https://www.sota2.com/nlp.stanford.edu/projects/snli/>)

Recorded evaluation configuration: {"Category":"Semantic Consistency","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

### Token confidence

AUC: 50.2. Result ID: 6996c5cd5698665ec4114a35.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

### Max token probability

AUC: 50. Result ID: 6996c5cd5698665ec4114a36.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

### Perplexity

AUC: 45.78. Result ID: 6996c5cd5698665ec4114a34.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence","LLM":"LLaMA2-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
