# Biomedical Question Answering on BioACE automatic evaluation N=50 runs

Source: [Biomedical Question Answering on BioACE automatic evaluation N=50 runs](<https://www.sota2.com/research/sota/biomedical-question-answering-on-bioace-automatic-evaluation-n-50-runs>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-19T09:36:23.395Z

Evaluation of model performance on the BioACE dataset (N=50 runs) for Biomedical Question Answering, reporting Precision, Recall, Completeness, and Correctness scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Biomedical Question Answering |
| Dataset (including any stated split) | BioACE automatic evaluation N=50 runs |
| Metric | Precision |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Precision](<https://www.sota2.com/research/sota/biomedical-question-answering-on-bioace-automatic-evaluation-n-50-runs.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/biomedical-question-answering-on-bioace-automatic-evaluation-n-50-runs.md?metric=Recall>): Higher is better; unit: PERCENT.

- [Completeness](<https://www.sota2.com/research/sota/biomedical-question-answering-on-bioace-automatic-evaluation-n-50-runs.md?metric=Completeness>): Higher is better; unit: PERCENT.

- [Correctness](<https://www.sota2.com/research/sota/biomedical-question-answering-on-bioace-automatic-evaluation-n-50-runs.md?metric=Correctness>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Precision | Result date | Report paper |
| --- | --- | --- | --- |
| agent\_faiss\_deepseek | 94.96 | Not recorded | 69bb83260636e5bf4afc1bc1 |
| rrf\_llama70b\_no-val | 94.68 | Not recorded | 69bb83260636e5bf4afc1bc1 |
| hltbio-lg.fsrrf | 93.22 | Not recorded | 69bb83260636e5bf4afc1bc1 |
| hltbio-lg.fsrrfprf | 92.52 | Not recorded | 69bb83260636e5bf4afc1bc1 |
| pubmedbert\_medcpt\_gpt4o | 89.02 | Not recorded | 69bb83260636e5bf4afc1bc1 |
| task\_b\_baseline | 82.23 | Not recorded | 69bb83260636e5bf4afc1bc1 |

### agent\_faiss\_deepseek

Precision: 94.96. Result ID: 69bbc39147f34ce924a604a0.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

Recorded evaluation configuration: {"Team":"dal"}. This record does not assert independent reproduction.

### rrf\_llama70b\_no-val

Precision: 94.68. Result ID: 69bbc39147f34ce924a604a1.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

Recorded evaluation configuration: {"Team":"dal"}. This record does not assert independent reproduction.

### hltbio-lg.fsrrf

Precision: 93.22. Result ID: 69bbc39147f34ce924a6049e.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

Recorded evaluation configuration: {"Team":"hltbio"}. This record does not assert independent reproduction.

### hltbio-lg.fsrrfprf

Precision: 92.52. Result ID: 69bbc39147f34ce924a6049f.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

Recorded evaluation configuration: {"Team":"hltbio"}. This record does not assert independent reproduction.

### pubmedbert\_medcpt\_gpt4o

Precision: 89.02. Result ID: 69bbc39147f34ce924a604a2.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

Recorded evaluation configuration: {"Team":"GEHC-HTIC"}. This record does not assert independent reproduction.

### task\_b\_baseline

Precision: 82.23. Result ID: 69bbc39147f34ce924a604a3.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83260636e5bf4afc1bc1.md>)

Recorded evaluation configuration: {"Team":"Baseline"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.