# Short-form open-domain QA on RQA

Source: [Short-form open-domain QA on RQA](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-02T08:03:25.353Z

Evaluation of model performance on the RQA dataset for Short-form open-domain Question Answering, measured using racc and asr.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Short-form open-domain QA |
| Dataset (including any stated split) | RQA |
| Metric | PIA Racc Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [PIA Racc Score](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa.md?metric=PIA%20Racc%20Score>): Higher is better; unit: PERCENT.

- [Racc Score](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa.md?metric=Racc%20Score>): Higher is better; unit: PERCENT.

- [ASR Score](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa.md?metric=ASR%20Score>): Higher is better; unit: PERCENT.

- [PIA ASR Score](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa.md?metric=PIA%20ASR%20Score>): Higher is better; unit: PERCENT.

- [Poison Racc Score](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa.md?metric=Poison%20Racc%20Score>): Higher is better; unit: PERCENT.

- [Poison ASR Score](<https://www.sota2.com/research/sota/short-form-open-domain-qa-on-rqa.md?metric=Poison%20ASR%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | PIA Racc Score | Result date | Report paper |
| --- | --- | --- | --- |
| Keyword | 72 | Not recorded | 68fa73511e209131cea5bcf5 |
| Keyword | 64 | Not recorded | 68fa73511e209131cea5bcf5 |
| Decoding\_c | 59 | Not recorded | 68fa73511e209131cea5bcf5 |
| Decoding\_c | 57 | Not recorded | 68fa73511e209131cea5bcf5 |
| Vanilla | 5 | Not recorded | 68fa73511e209131cea5bcf5 |
| Vanilla | 1 | Not recorded | 68fa73511e209131cea5bcf5 |

### Keyword

PIA Racc Score: 72. Result ID: 69ce22ba47f34ce924b730ef.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

Recorded evaluation configuration: {"LLM":"Mistral-7B"}. This record does not assert independent reproduction.

### Keyword

PIA Racc Score: 64. Result ID: 69ce22ba47f34ce924b730f2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

Recorded evaluation configuration: {"LLM":"Llama2-7B"}. This record does not assert independent reproduction.

### Decoding\_c

PIA Racc Score: 59. Result ID: 69ce22ba47f34ce924b730f3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

Recorded evaluation configuration: {"LLM":"Llama2-7B"}. This record does not assert independent reproduction.

### Decoding\_c

PIA Racc Score: 57. Result ID: 69ce22ba47f34ce924b730f0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

Recorded evaluation configuration: {"LLM":"Mistral-7B"}. This record does not assert independent reproduction.

### Vanilla

PIA Racc Score: 5. Result ID: 69ce22ba47f34ce924b730ee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

Recorded evaluation configuration: {"LLM":"Mistral-7B"}. This record does not assert independent reproduction.

### Vanilla

PIA Racc Score: 1. Result ID: 69ce22ba47f34ce924b730f1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73511e209131cea5bcf5.md>)

Recorded evaluation configuration: {"LLM":"Llama2-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.