# Conversational Question Answering on CoQA

Source: [Conversational Question Answering on CoQA](<https://www.sota2.com/research/sota/conversational-question-answering-on-coqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:43:48.629Z

Evaluation of model performance on the CoQA dataset for Conversational Question Answering, typically reporting F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Conversational Question Answering |
| Dataset (including any stated split) | CoQA |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/conversational-question-answering-on-coqa.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| RWKV-7B | 62.65 | Not recorded | 68fa75391e209131cea668f7 |
| Mamba-2.8B | 56.35 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 52.66 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 49.55 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 48.32 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 44.96 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 44.96 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 40.54 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 29.65 | Not recorded | 68fa75391e209131cea668f7 |
| ShortGPT | 28.34 | Not recorded | 68fa75391e209131cea668f7 |

### RWKV-7B

F1 Score: 62.65. Result ID: 699381123a6c314849166ce3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71611e209131cea50f7f.md>)

[Implementation](<https://github.com/BlinkDL/RWKV-LM>)

Recorded evaluation configuration: {"Backbone":"RWKV-7B","Pruning ratio":"0%"}. This record does not assert independent reproduction.

### Mamba-2.8B

F1 Score: 56.35. Result ID: 699381123a6c314849166cde.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73611e209131cea5c0fe.md>)

Recorded evaluation configuration: {"Backbone":"Mamba-2.8B","Pruning ratio":"0%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 52.66. Result ID: 699381123a6c314849166cdf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"Mamba-2.8B","Pruning ratio":"10.9%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 49.55. Result ID: 699381123a6c314849166ce4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"RWKV-7B","Pruning ratio":"9.4%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 48.32. Result ID: 699381123a6c314849166ce0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"Mamba-2.8B","Pruning ratio":"20.3%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 44.96. Result ID: 699381123a6c314849166ce1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"Mamba-2.8B","Pruning ratio":"25%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 44.96. Result ID: 699381123a6c314849166ce2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"Mamba-2.8B","Pruning ratio":"31.3%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 40.54. Result ID: 699381123a6c314849166ce5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"RWKV-7B","Pruning ratio":"18.8%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 29.65. Result ID: 699381123a6c314849166ce6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"RWKV-7B","Pruning ratio":"25%"}. This record does not assert independent reproduction.

### ShortGPT

F1 Score: 28.34. Result ID: 699381123a6c314849166ce7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75391e209131cea668f7.md>)

Recorded evaluation configuration: {"Backbone":"RWKV-7B","Pruning ratio":"28.1%"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.