# Information Retrieval on NFCorpus (Leakage, Confidence, NDCG@10)

Source: [Information Retrieval on NFCorpus (Leakage, Confidence, NDCG@10)](<https://www.sota2.com/research/sota/information-retrieval-on-nfcorpus-leakage-confidence-ndcg-at-10>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:48:33.895Z

Evaluation of Information Retrieval performance on the NFCorpus dataset, focusing on metrics including Leakage, Confidence, and Downstream NDCG@10.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Information Retrieval |
| Dataset (including any stated split) | NFCorpus |
| Metric | Leakage |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Leakage](<https://www.sota2.com/research/sota/information-retrieval-on-nfcorpus-leakage-confidence-ndcg-at-10.md?metric=Leakage>): Lower is better; unit: SCALAR.

- [Confidence](<https://www.sota2.com/research/sota/information-retrieval-on-nfcorpus-leakage-confidence-ndcg-at-10.md?metric=Confidence>): Higher is better; unit: SCALAR.

- [NDCG@10 (Downstream)](<https://www.sota2.com/research/sota/information-retrieval-on-nfcorpus-leakage-confidence-ndcg-at-10.md?metric=NDCG%4010%20(Downstream)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Leakage | Result date | Report paper |
| --- | --- | --- | --- |
| SPARSE | 0.68 | Not recorded | 698abbaec97a0b3e3b5de035 |
| LapMech | 7.77 | Not recorded | 698abbaec97a0b3e3b5de035 |
| PurMech | 8.45 | Not recorded | 698abbaec97a0b3e3b5de035 |
| SPARSE | 12.16 | Not recorded | 698abbaec97a0b3e3b5de035 |
| LapMech | 29.73 | Not recorded | 698abbaec97a0b3e3b5de035 |
| PurMech | 31.42 | Not recorded | 698abbaec97a0b3e3b5de035 |
| SPARSE | 46.96 | Not recorded | 698abbaec97a0b3e3b5de035 |
| PurMech | 55.41 | Not recorded | 698abbaec97a0b3e3b5de035 |
| LapMech | 56.76 | Not recorded | 698abbaec97a0b3e3b5de035 |
| SPARSE | 57.77 | Not recorded | 698abbaec97a0b3e3b5de035 |
| SPARSE | 66.55 | Not recorded | 698abbaec97a0b3e3b5de035 |
| PurMech | 69.26 | Not recorded | 698abbaec97a0b3e3b5de035 |
| LapMech | 69.93 | Not recorded | 698abbaec97a0b3e3b5de035 |
| LapMech | 78.72 | Not recorded | 698abbaec97a0b3e3b5de035 |
| PurMech | 79.05 | Not recorded | 698abbaec97a0b3e3b5de035 |
| Non-protected | 88.18 | Not recorded | 698abbaec97a0b3e3b5de035 |

### SPARSE

Leakage: 0.68. Result ID: 6996dcfd5698665ec4297169.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"5"}. This record does not assert independent reproduction.

### LapMech

Leakage: 7.77. Result ID: 6996dcfd5698665ec4297167.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea11097.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"5"}. This record does not assert independent reproduction.

### PurMech

Leakage: 8.45. Result ID: 6996dcfd5698665ec4297168.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea1108e.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"5"}. This record does not assert independent reproduction.

### SPARSE

Leakage: 12.16. Result ID: 6996dcfd5698665ec429716c.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"10"}. This record does not assert independent reproduction.

### LapMech

Leakage: 29.73. Result ID: 6996dcfd5698665ec429716a.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea11097.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"10"}. This record does not assert independent reproduction.

### PurMech

Leakage: 31.42. Result ID: 6996dcfd5698665ec429716b.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea1108e.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"10"}. This record does not assert independent reproduction.

### SPARSE

Leakage: 46.96. Result ID: 6996dcfd5698665ec429716f.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"20"}. This record does not assert independent reproduction.

### PurMech

Leakage: 55.41. Result ID: 6996dcfd5698665ec429716e.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea1108e.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"20"}. This record does not assert independent reproduction.

### LapMech

Leakage: 56.76. Result ID: 6996dcfd5698665ec429716d.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea11097.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"20"}. This record does not assert independent reproduction.

### SPARSE

Leakage: 57.77. Result ID: 6996dcfd5698665ec4297172.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"30"}. This record does not assert independent reproduction.

### SPARSE

Leakage: 66.55. Result ID: 6996dcfd5698665ec4297175.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"40"}. This record does not assert independent reproduction.

### PurMech

Leakage: 69.26. Result ID: 6996dcfd5698665ec4297171.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea1108e.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"30"}. This record does not assert independent reproduction.

### LapMech

Leakage: 69.93. Result ID: 6996dcfd5698665ec4297170.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea11097.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"30"}. This record does not assert independent reproduction.

### LapMech

Leakage: 78.72. Result ID: 6996dcfd5698665ec4297173.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea11097.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"40"}. This record does not assert independent reproduction.

### PurMech

Leakage: 79.05. Result ID: 6996dcfd5698665ec4297174.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66931e209131cea1108e.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"40"}. This record does not assert independent reproduction.

### Non-protected

Leakage: 88.18. Result ID: 6996dcfd5698665ec4297176.

[Reporting paper](<https://www.sota2.com/research/paper/698abbaec97a0b3e3b5de035.md>)

Recorded evaluation configuration: {"epsilon (ϵ)":"infinity"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
