# Hallucination Detection on MetaQA 1hop (Qwen2.5-7B)

Source: [Hallucination Detection on MetaQA 1hop (Qwen2.5-7B)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-qwen2-5-7b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-27T08:04:33.055Z

Evaluation of model performance on hallucination detection using the MetaQA 1hop dataset, specifically reflecting results obtained using the Qwen2.5-7B model configuration.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hallucination Detection |
| Dataset (including any stated split) | MetaQA 1hop (Qwen2.5-7B) |
| Metric | AUC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-qwen2-5-7b.md?metric=AUC>): Higher is better; unit: PERCENT.

- [F1 (Class 1)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-qwen2-5-7b.md?metric=F1%20(Class%201)>): Higher is better; unit: PERCENT.

- [F1 (Macro Avg)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-qwen2-5-7b.md?metric=F1%20(Macro%20Avg)>): Higher is better; unit: PERCENT.

- [Precision (Class 1)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-qwen2-5-7b.md?metric=Precision%20(Class%201)>): Higher is better; unit: PERCENT.

- [Recall (Class 1)](<https://www.sota2.com/research/sota/hallucination-detection-on-metaqa-1hop-qwen2-5-7b.md?metric=Recall%20(Class%201)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUC | Result date | Report paper |
| --- | --- | --- | --- |
| GGA (PRD + SAS) | 85.28 | Not recorded | 693a501f6cfd488761a54b4d |
| SSR + SAS | 85.28 | Not recorded | 6a167aa8dbd7150506f80076 |
| NLI Contradiction | 50.44 | Not recorded | 693a501f6cfd488761a54b4d |
| NLI Contradiction | 50.44 | Not recorded | 6a167aa8dbd7150506f80076 |
| Token confidence | 49.66 | Not recorded | 693a501f6cfd488761a54b4d |
| Token confidence | 49.66 | Not recorded | 6a167aa8dbd7150506f80076 |
| Perplexity | 49.35 | Not recorded | 693a501f6cfd488761a54b4d |
| Perplexity | 49.35 | Not recorded | 6a167aa8dbd7150506f80076 |
| Embedding Divergence | 49 | Not recorded | 693a501f6cfd488761a54b4d |
| Embedding Divergence | 49 | Not recorded | 6a167aa8dbd7150506f80076 |
| BERTScore | 48.67 | Not recorded | 693a501f6cfd488761a54b4d |
| BERTScore | 48.67 | Not recorded | 6a167aa8dbd7150506f80076 |
| Max token probability | 44.19 | Not recorded | 693a501f6cfd488761a54b4d |
| Max token probability | 44.19 | Not recorded | 6a167aa8dbd7150506f80076 |

### GGA (PRD + SAS)

AUC: 85.28. Result ID: 6996c5cd5698665ec4114a41.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Our Method","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### SSR + SAS

AUC: 85.28. Result ID: 6a16a58cfbc373592c0fa30d.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

Recorded evaluation configuration: {"Category":"Mechanistic Detector"}. This record does not assert independent reproduction.

### NLI Contradiction

AUC: 50.44. Result ID: 6996c5cd5698665ec4114a40.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62151e209131ce9f76f2.md>)

[Implementation](<https://www.sota2.com/nlp.stanford.edu/projects/snli/>)

Recorded evaluation configuration: {"Category":"Semantic Consistency","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### NLI Contradiction

AUC: 50.44. Result ID: 6a16a58cfbc373592c0fa30c.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62151e209131ce9f76f2.md>)

[Implementation](<https://www.sota2.com/nlp.stanford.edu/projects/snli/>)

Recorded evaluation configuration: {"Category":"Semantic Consistency"}. This record does not assert independent reproduction.

### Token confidence

AUC: 49.66. Result ID: 6996c5cd5698665ec4114a3c.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### Token confidence

AUC: 49.66. Result ID: 6a16a58cfbc373592c0fa308.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence"}. This record does not assert independent reproduction.

### Perplexity

AUC: 49.35. Result ID: 6996c5cd5698665ec4114a3b.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### Perplexity

AUC: 49.35. Result ID: 6a16a58cfbc373592c0fa307.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d71e209131cea4d943.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence"}. This record does not assert independent reproduction.

### Embedding Divergence

AUC: 49. Result ID: 6996c5cd5698665ec4114a3f.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Semantic Consistency","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### Embedding Divergence

AUC: 49. Result ID: 6a16a58cfbc373592c0fa30b.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66441e209131cea0f5ab.md>)

[Implementation](<https://github.com/UKPLab/sentence-transformers>)

Recorded evaluation configuration: {"Category":"Semantic Consistency"}. This record does not assert independent reproduction.

### BERTScore

AUC: 48.67. Result ID: 6996c5cd5698665ec4114a3e.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67171e209131cea140d5.md>)

Recorded evaluation configuration: {"Category":"Semantic Consistency","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### BERTScore

AUC: 48.67. Result ID: 6a16a58cfbc373592c0fa30a.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67171e209131cea140d5.md>)

Recorded evaluation configuration: {"Category":"Semantic Consistency"}. This record does not assert independent reproduction.

### Max token probability

AUC: 44.19. Result ID: 6996c5cd5698665ec4114a3d.

[Reporting paper](<https://www.sota2.com/research/paper/693a501f6cfd488761a54b4d.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence","LLM":"Qwen2.5-7B"}. This record does not assert independent reproduction.

### Max token probability

AUC: 44.19. Result ID: 6a16a58cfbc373592c0fa309.

[Reporting paper](<https://www.sota2.com/research/paper/6a167aa8dbd7150506f80076.md>)

Recorded evaluation configuration: {"Category":"Model-Internal Confidence"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
