# Information Retrieval on FiQA (Faithfulness and Hit@k)

Source: [Information Retrieval on FiQA (Faithfulness and Hit@k)](<https://www.sota2.com/research/sota/information-retrieval-on-fiqa-faithfulness-and-hit-at-k>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-31T08:40:30.401Z

Evaluation of Information Retrieval performance on the FiQA dataset, focusing on faithfulness, hit rate (Hit@k), and latency (p95).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Information Retrieval |
| Dataset (including any stated split) | FiQA |
| Metric | Faithfulness |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Faithfulness](<https://www.sota2.com/research/sota/information-retrieval-on-fiqa-faithfulness-and-hit-at-k.md?metric=Faithfulness>): Higher is better; unit: PERCENT.

- [Hit@k](<https://www.sota2.com/research/sota/information-retrieval-on-fiqa-faithfulness-and-hit-at-k.md?metric=Hit%40k>): Higher is better; unit: PERCENT.

- [Latency (p95)](<https://www.sota2.com/research/sota/information-retrieval-on-fiqa-faithfulness-and-hit-at-k.md?metric=Latency%20(p95)>): Lower is better; unit: TIME.

## Recorded results

| Method | Faithfulness | Result date | Report paper |
| --- | --- | --- | --- |
| gpt-4.1-mini | 79 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1-mini | 78 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1-mini | 75 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1-mini | 73 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1-mini | 72 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1-mini | 71 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1 | 67 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1 | 67 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1 | 65 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1 | 65 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1 | 65 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-4.1 | 61 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-5.2 | 39 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-5.2 | 39 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-5.2 | 39 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-5.2 | 39 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-5.2 | 37 | Not recorded | 69cb54fd0636e5bf4afc9e72 |
| gpt-5.2 | 36 | Not recorded | 69cb54fd0636e5bf4afc9e72 |

### gpt-4.1-mini

Faithfulness: 79. Result ID: 69cb882f47f34ce924b3dbb1.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Cost-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1-mini

Faithfulness: 78. Result ID: 69cb882f47f34ce924b3dbb5.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"SLA-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1-mini

Faithfulness: 75. Result ID: 69cb882f47f34ce924b3dbb3.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Risk-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1-mini

Faithfulness: 73. Result ID: 69cb882f47f34ce924b3dbb0.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Cost-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1-mini

Faithfulness: 72. Result ID: 69cb882f47f34ce924b3dbb2.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Risk-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1-mini

Faithfulness: 71. Result ID: 69cb882f47f34ce924b3dbb4.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"SLA-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1

Faithfulness: 67. Result ID: 69cb882f47f34ce924b3dbad.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Risk-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1

Faithfulness: 67. Result ID: 69cb882f47f34ce924b3dbaf.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"SLA-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1

Faithfulness: 65. Result ID: 69cb882f47f34ce924b3dbaa.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Cost-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1

Faithfulness: 65. Result ID: 69cb882f47f34ce924b3dbab.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Cost-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1

Faithfulness: 65. Result ID: 69cb882f47f34ce924b3dbac.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Risk-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-4.1

Faithfulness: 61. Result ID: 69cb882f47f34ce924b3dbae.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"SLA-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-5.2

Faithfulness: 39. Result ID: 69cb882f47f34ce924b3dbb6.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Cost-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-5.2

Faithfulness: 39. Result ID: 69cb882f47f34ce924b3dbb7.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Cost-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-5.2

Faithfulness: 39. Result ID: 69cb882f47f34ce924b3dbb9.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Risk-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-5.2

Faithfulness: 39. Result ID: 69cb882f47f34ce924b3dbbb.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"SLA-first","k":"5","Runs":"3"}. This record does not assert independent reproduction.

### gpt-5.2

Faithfulness: 37. Result ID: 69cb882f47f34ce924b3dbba.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"SLA-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

### gpt-5.2

Faithfulness: 36. Result ID: 69cb882f47f34ce924b3dbb8.

[Reporting paper](<https://www.sota2.com/research/paper/69cb54fd0636e5bf4afc9e72.md>)

Recorded evaluation configuration: {"Scenario":"Risk-first","k":"3","Runs":"3"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
