# Clinical Question Answering on ArchEHR-QA 2026 (test)

Source: [Clinical Question Answering on ArchEHR-QA 2026 (test)](<https://www.sota2.com/research/sota/clinical-question-answering-on-archehr-qa-2026-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-12T16:55:33.784Z

Evaluation of model performance on the test split of the ArchEHR-QA 2026 dataset for the Clinical Question Answering task, measured using ST1, ST2, ST3, ST4, and Mean Rank.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Clinical Question Answering |
| Dataset (including any stated split) | ArchEHR-QA 2026 (test) |
| Metric | ST1 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ST1](<https://www.sota2.com/research/sota/clinical-question-answering-on-archehr-qa-2026-test.md?metric=ST1>): Higher is better; unit: SCALAR.

- [ST2](<https://www.sota2.com/research/sota/clinical-question-answering-on-archehr-qa-2026-test.md?metric=ST2>): Higher is better; unit: SCALAR.

- [ST3](<https://www.sota2.com/research/sota/clinical-question-answering-on-archehr-qa-2026-test.md?metric=ST3>): Higher is better; unit: SCALAR.

- [ST4](<https://www.sota2.com/research/sota/clinical-question-answering-on-archehr-qa-2026-test.md?metric=ST4>): Higher is better; unit: SCALAR.

- [Mean Rank](<https://www.sota2.com/research/sota/clinical-question-answering-on-archehr-qa-2026-test.md?metric=Mean%20Rank>): Lower is better; unit: SCALAR.

## Recorded results

| Method | ST1 | Result date | Report paper |
| --- | --- | --- | --- |
| BIT.UA-AAUBS | 13 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| TAMU-NLP-Lab | 11 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| WisPerMed | 6 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| Yale-DM-Lab | 5 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| Neural1.5 | 4 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| OptiMed | 3 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| KPSCMI | 2 | Not recorded | 6a02b4b2dbc836b87d824f95 |
| HealthNLLP\_Ret. | 1 | Not recorded | 6a02b4b2dbc836b87d824f95 |

### BIT.UA-AAUBS

ST1: 13. Result ID: 6a035b6a47f34ce924e8f9d7.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TAMU-NLP-Lab

ST1: 11. Result ID: 6a035b6a47f34ce924e8f9d6.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### WisPerMed

ST1: 6. Result ID: 6a035b6a47f34ce924e8f9d2.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Yale-DM-Lab

ST1: 5. Result ID: 6a035b6a47f34ce924e8f9d5.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Neural1.5

ST1: 4. Result ID: 6a035b6a47f34ce924e8f9d1.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OptiMed

ST1: 3. Result ID: 6a035b6a47f34ce924e8f9d0.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### KPSCMI

ST1: 2. Result ID: 6a035b6a47f34ce924e8f9d4.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HealthNLLP\_Ret.

ST1: 1. Result ID: 6a035b6a47f34ce924e8f9d3.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4b2dbc836b87d824f95.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.