# Fact-checking on HOVER 3-hop (test)

Source: [Fact-checking on HOVER 3-hop (test)](<https://www.sota2.com/research/sota/fact-checking-on-hover-3-hop-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:51:27.005Z

Evaluation of model performance on the test split of the HOVER 3-hop dataset for Fact-checking, reporting Macro-F1.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fact-checking |
| Dataset (including any stated split) | HOVER 3-hop (test) |
| Metric | Macro F1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Macro F1](<https://www.sota2.com/research/sota/fact-checking-on-hover-3-hop-test.md?metric=Macro%20F1>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Macro F1 | Result date | Report paper |
| --- | --- | --- | --- |
| Trification | 66.42 | Not recorded | 692e727ed6b0dd33429322b3 |
| LoCaL | 64.11 | Not recorded | 692e727ed6b0dd33429322b3 |
| PACAR | 64.07 | Not recorded | 692e727ed6b0dd33429322b3 |
| ProgramFC | 63.43 | Not recorded | 692e727ed6b0dd33429322b3 |
| Trification | 61.56 | Not recorded | 692e727ed6b0dd33429322b3 |
| DeBERTaV3-NLI | 60.76 | Not recorded | 692e727ed6b0dd33429322b3 |
| ProgramFC | 60.63 | Not recorded | 692e727ed6b0dd33429322b3 |
| ChatGPT | 60.56 | Not recorded | 692e727ed6b0dd33429322b3 |
| SearChain | 60.3 | Not recorded | 692e727ed6b0dd33429322b3 |
| Flan-T5 | 60.23 | Not recorded | 692e727ed6b0dd33429322b3 |
| Codex | 56.63 | Not recorded | 692e727ed6b0dd33429322b3 |
| Trification | 55.1 | Not recorded | 692e727ed6b0dd33429322b3 |
| RoBERTa-NLI | 53.99 | Not recorded | 692e727ed6b0dd33429322b3 |
| MUTIVERS | 52.55 | Not recorded | 692e727ed6b0dd33429322b3 |
| LisT5 | 51.86 | Not recorded | 692e727ed6b0dd33429322b3 |
| BERT-FC | 49.86 | Not recorded | 692e727ed6b0dd33429322b3 |

### Trification

Macro F1: 66.42. Result ID: 699635695698665ec477c692.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"Our","Method Components":"Full"}. This record does not assert independent reproduction.

### LoCaL

Macro F1: 64.11. Result ID: 699635695698665ec477c690.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"IV"}. This record does not assert independent reproduction.

### PACAR

Macro F1: 64.07. Result ID: 699635695698665ec477c68f.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"III"}. This record does not assert independent reproduction.

### ProgramFC

Macro F1: 63.43. Result ID: 699635695698665ec477c68e.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f651e209131cea4547c.md>)

Recorded evaluation configuration: {"Model Category":"III","Number of programs (N)":5}. This record does not assert independent reproduction.

### Trification

Macro F1: 61.56. Result ID: 699635695698665ec477c693.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"Our","Method Components":"w/o REFINE"}. This record does not assert independent reproduction.

### DeBERTaV3-NLI

Macro F1: 60.76. Result ID: 699635695698665ec477c688.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee11e209131cea4297b.md>)

[Implementation](<https://github.com/microsoft/DeBERTa>)

Recorded evaluation configuration: {"Model Category":"I"}. This record does not assert independent reproduction.

### ProgramFC

Macro F1: 60.63. Result ID: 699635695698665ec477c68d.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f651e209131cea4547c.md>)

Recorded evaluation configuration: {"Model Category":"III","Number of programs (N)":1}. This record does not assert independent reproduction.

### ChatGPT

Macro F1: 60.56. Result ID: 699635695698665ec477c68a.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"II"}. This record does not assert independent reproduction.

### SearChain

Macro F1: 60.3. Result ID: 699635695698665ec477c691.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72571e209131cea55c77.md>)

[Implementation](<https://github.com/xsc1234/Search-in-the-Chain>)

Recorded evaluation configuration: {"Model Category":"IV"}. This record does not assert independent reproduction.

### Flan-T5

Macro F1: 60.23. Result ID: 699635695698665ec477c68c.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e201e209131cea3dfa7.md>)

[Implementation](<https://github.com/google-research/t5x/blob/main/docs/models.md#flan-t5-checkpoints>)

Recorded evaluation configuration: {"Model Category":"II"}. This record does not assert independent reproduction.

### Codex

Macro F1: 56.63. Result ID: 699635695698665ec477c68b.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a5f1e209131cea27ced.md>)

[Implementation](<https://www.github.com/openai/human-eval>)

Recorded evaluation configuration: {"Model Category":"II"}. This record does not assert independent reproduction.

### Trification

Macro F1: 55.1. Result ID: 699635695698665ec477c694.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"Our","Method Components":"w/o REFINE and THINK"}. This record does not assert independent reproduction.

### RoBERTa-NLI

Macro F1: 53.99. Result ID: 699635695698665ec477c687.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa677a1e209131cea16a73.md>)

Recorded evaluation configuration: {"Model Category":"I"}. This record does not assert independent reproduction.

### MUTIVERS

Macro F1: 52.55. Result ID: 699635695698665ec477c689.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"I"}. This record does not assert independent reproduction.

### LisT5

Macro F1: 51.86. Result ID: 699635695698665ec477c686.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

Recorded evaluation configuration: {"Model Category":"I"}. This record does not assert independent reproduction.

### BERT-FC

Macro F1: 49.86. Result ID: 699635695698665ec477c685.

[Reporting paper](<https://www.sota2.com/research/paper/692e727ed6b0dd33429322b3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66771e209131cea1054f.md>)

Recorded evaluation configuration: {"Model Category":"I"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
