# Information Retrieval on Scifact (Recall@100, NDCG@10)

Source: [Information Retrieval on Scifact (Recall@100, NDCG@10)](<https://www.sota2.com/research/sota/information-retrieval-on-scifact-recall-at-100-ndcg-at-10>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-24T12:57:23.114Z

Evaluation of Information Retrieval performance on the SciFact dataset, focusing on Recall@100 and NDCG@10 metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Information Retrieval |
| Dataset (including any stated split) | scifact |
| Metric | Recall@100 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 19 of 19 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall@100](<https://www.sota2.com/research/sota/information-retrieval-on-scifact-recall-at-100-ndcg-at-10.md?metric=Recall%40100>): Higher is better; unit: PERCENT.

- [NDCG@10](<https://www.sota2.com/research/sota/information-retrieval-on-scifact-recall-at-100-ndcg-at-10.md?metric=NDCG%4010>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Recall@100 | Result date | Report paper |
| --- | --- | --- | --- |
| ReBOL-QR-Greedy | 96.7 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-QR-UCB | 96.7 | Not recorded | 69c21a910636e5bf4afc48dd |
| Dense (QR) | 96.6 | Not recorded | 69c21a910636e5bf4afc48dd |
| PW (QR) | 96.6 | Not recorded | 69c21a910636e5bf4afc48dd |
| LW-one-call (QR) | 96.6 | Not recorded | 69c21a910636e5bf4afc48dd |
| LW-window (QR) | 96.6 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-QR-Rand. | 96.2 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-IQ-Greedy | 96 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-IQ-UCB | 93.7 | Not recorded | 69c21a910636e5bf4afc48dd |
| SPLADE | 93.5 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-QR-Top-k | 93.5 | Not recorded | 69c21a910636e5bf4afc48dd |
| Dense (IQ) | 92.8 | Not recorded | 69c21a910636e5bf4afc48dd |
| PW (IQ) | 92.8 | Not recorded | 69c21a910636e5bf4afc48dd |
| LW-one-call (IQ) | 92.8 | Not recorded | 69c21a910636e5bf4afc48dd |
| LW-window (IQ) | 92.8 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-IQ-Top-k | 92.8 | Not recorded | 69c21a910636e5bf4afc48dd |
| BM25 Flat | 92.5 | Not recorded | 69c21a910636e5bf4afc48dd |
| ReBOL-IQ-Rand. | 91.2 | Not recorded | 69c21a910636e5bf4afc48dd |
| BM25 MF | 90.8 | Not recorded | 69c21a910636e5bf4afc48dd |

### ReBOL-QR-Greedy

Recall@100: 96.7. Result ID: 69c28a2947f34ce924aaa4b1.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"QR","Acquisition":"Greedy","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### ReBOL-QR-UCB

Recall@100: 96.7. Result ID: 69c28a2947f34ce924aaa4b2.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"QR","Acquisition":"UCB","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### Dense (QR)

Recall@100: 96.6. Result ID: 69c28a2947f34ce924aaa4a7.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"QR","Backbone":"all-MiniLM-L6-v2"}. This record does not assert independent reproduction.

### PW (QR)

Recall@100: 96.6. Result ID: 69c28a2947f34ce924aaa4a8.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa738a1e209131cea5d110.md>)

Recorded evaluation configuration: {"Query Variant":"QR","LLM":"Gemini-2.5-Flash-Lite","Method Class":"Pairwise"}. This record does not assert independent reproduction.

### LW-one-call (QR)

Recall@100: 96.6. Result ID: 69c28a2947f34ce924aaa4a9.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f301e209131cea44528.md>)

Recorded evaluation configuration: {"Query Variant":"QR","LLM":"Gemini-2.5-Flash-Lite","Method Class":"Listwise","Mode":"one-call"}. This record does not assert independent reproduction.

### LW-window (QR)

Recall@100: 96.6. Result ID: 69c28a2947f34ce924aaa4aa.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f301e209131cea44528.md>)

Recorded evaluation configuration: {"Query Variant":"QR","LLM":"Gemini-2.5-Flash-Lite","Method Class":"Listwise","Mode":"window"}. This record does not assert independent reproduction.

### ReBOL-QR-Rand.

Recall@100: 96.2. Result ID: 69c28a2947f34ce924aaa4af.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"QR","Acquisition":"Random","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### ReBOL-IQ-Greedy

Recall@100: 96. Result ID: 69c28a2947f34ce924aaa4ad.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","Acquisition":"Greedy","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### ReBOL-IQ-UCB

Recall@100: 93.7. Result ID: 69c28a2947f34ce924aaa4ae.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","Acquisition":"UCB","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### SPLADE

Recall@100: 93.5. Result ID: 69c28a2947f34ce924aaa4a2.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ReBOL-QR-Top-k

Recall@100: 93.5. Result ID: 69c28a2947f34ce924aaa4b0.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"QR","Acquisition":"Top-k","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### Dense (IQ)

Recall@100: 92.8. Result ID: 69c28a2947f34ce924aaa4a3.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","Backbone":"all-MiniLM-L6-v2"}. This record does not assert independent reproduction.

### PW (IQ)

Recall@100: 92.8. Result ID: 69c28a2947f34ce924aaa4a4.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa738a1e209131cea5d110.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","LLM":"Gemini-2.5-Flash-Lite","Method Class":"Pairwise"}. This record does not assert independent reproduction.

### LW-one-call (IQ)

Recall@100: 92.8. Result ID: 69c28a2947f34ce924aaa4a5.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f301e209131cea44528.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","LLM":"Gemini-2.5-Flash-Lite","Method Class":"Listwise","Mode":"one-call"}. This record does not assert independent reproduction.

### LW-window (IQ)

Recall@100: 92.8. Result ID: 69c28a2947f34ce924aaa4a6.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f301e209131cea44528.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","LLM":"Gemini-2.5-Flash-Lite","Method Class":"Listwise","Mode":"window"}. This record does not assert independent reproduction.

### ReBOL-IQ-Top-k

Recall@100: 92.8. Result ID: 69c28a2947f34ce924aaa4ac.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","Acquisition":"Top-k","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### BM25 Flat

Recall@100: 92.5. Result ID: 69c28a2947f34ce924aaa4a0.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"type":"Flat"}. This record does not assert independent reproduction.

### ReBOL-IQ-Rand.

Recall@100: 91.2. Result ID: 69c28a2947f34ce924aaa4ab.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"Query Variant":"IQ","Acquisition":"Random","LLM":"Gemini-2.5-Flash-Lite"}. This record does not assert independent reproduction.

### BM25 MF

Recall@100: 90.8. Result ID: 69c28a2947f34ce924aaa4a1.

[Reporting paper](<https://www.sota2.com/research/paper/69c21a910636e5bf4afc48dd.md>)

Recorded evaluation configuration: {"type":"MF"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
