# Question Answering on NQ (Corr. and Err.)

Source: [Question Answering on NQ (Corr. and Err.)](<https://www.sota2.com/research/sota/question-answering-on-nq-corr-and-err>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-20T09:44:31.465Z

Evaluation of model performance on the Natural Questions (NQ) dataset for Question Answering, reporting Correlation/Correctness and Error Rate metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Question Answering |
| Dataset (including any stated split) | NQ |
| Metric | Correlation Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 35 of 35 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Correlation Score](<https://www.sota2.com/research/sota/question-answering-on-nq-corr-and-err.md?metric=Correlation%20Score>): Higher is better; unit: SCALAR.

- [Error Rate](<https://www.sota2.com/research/sota/question-answering-on-nq-corr-and-err.md?metric=Error%20Rate>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Correlation Score | Result date | Report paper |
| --- | --- | --- | --- |
| LLM-RAG | 763 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 763 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 760 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 759 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 757 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 753 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 752 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 747 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 743 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 741 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 736 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 734 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 718 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 709 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 698 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 615 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 615 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 590 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 590 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 575 | Not recorded | 6a0d405bf984739ed6737b7f |
| UCB-Cascaded | 563 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 562 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 532 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 531 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 492 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-RAG | 489 | Not recorded | 6a0d405bf984739ed6737b7f |
| BalanceRAG | 447 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 320 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 283 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 240 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 191 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 158 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 134 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 125 | Not recorded | 6a0d405bf984739ed6737b7f |
| LLM-only | 119 | Not recorded | 6a0d405bf984739ed6737b7f |

### LLM-RAG

Correlation Score: 763. Result ID: 6a0d826cfbc373592c05f996.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 763. Result ID: 6a0d826cfbc373592c05f997.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 760. Result ID: 6a0d826cfbc373592c05f995.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 759. Result ID: 6a0d826cfbc373592c05f9a1.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 757. Result ID: 6a0d826cfbc373592c05f9a0.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 753. Result ID: 6a0d826cfbc373592c05f99f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 752. Result ID: 6a0d826cfbc373592c05f994.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.16"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 747. Result ID: 6a0d826cfbc373592c05f99c.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 743. Result ID: 6a0d826cfbc373592c05f99b.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 741. Result ID: 6a0d826cfbc373592c05f99e.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.16"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 736. Result ID: 6a0d826cfbc373592c05f99a.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 734. Result ID: 6a0d826cfbc373592c05f993.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.15"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 718. Result ID: 6a0d826cfbc373592c05f999.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.16"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 709. Result ID: 6a0d826cfbc373592c05f99d.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.15"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 698. Result ID: 6a0d826cfbc373592c05f998.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.15"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 615. Result ID: 6a0d826cfbc373592c05f986.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 615. Result ID: 6a0d826cfbc373592c05f98d.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 590. Result ID: 6a0d826cfbc373592c05f985.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 590. Result ID: 6a0d826cfbc373592c05f988.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 575. Result ID: 6a0d826cfbc373592c05f98c.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### UCB-Cascaded

Correlation Score: 563. Result ID: 6a0d826cfbc373592c05f987.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74421e209131cea60928.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 562. Result ID: 6a0d826cfbc373592c05f984.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 532. Result ID: 6a0d826cfbc373592c05f983.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.16"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 531. Result ID: 6a0d826cfbc373592c05f98b.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 492. Result ID: 6a0d826cfbc373592c05f98a.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.16"}. This record does not assert independent reproduction.

### LLM-RAG

Correlation Score: 489. Result ID: 6a0d826cfbc373592c05f982.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.15"}. This record does not assert independent reproduction.

### BalanceRAG

Correlation Score: 447. Result ID: 6a0d826cfbc373592c05f989.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.15"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 320. Result ID: 6a0d826cfbc373592c05f992.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 283. Result ID: 6a0d826cfbc373592c05f991.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 240. Result ID: 6a0d826cfbc373592c05f990.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 191. Result ID: 6a0d826cfbc373592c05f98f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.16"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 158. Result ID: 6a0d826cfbc373592c05f98e.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.1-8B","Target risk level (alpha)":"0.15"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 134. Result ID: 6a0d826cfbc373592c05f981.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.19"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 125. Result ID: 6a0d826cfbc373592c05f980.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.18"}. This record does not assert independent reproduction.

### LLM-only

Correlation Score: 119. Result ID: 6a0d826cfbc373592c05f97f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0d405bf984739ed6737b7f.md>)

Recorded evaluation configuration: {"Backbone":"Llama3.2-3B","Target risk level (alpha)":"0.17"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
