BioASQ
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BioASQ
43.96Snippet-F1
9
BioASQ (test)
46Top-20
9
BioASQ (test)
54.8ROUGE
8
BioASQ MRQA Out-of-domain
49.37F1 Score
8
BioASQ
71.28Macro F1
8
BioASQ (test)
28.55ROUGE-1
8
BioASQ
76.9nDCG@10
8
BioASQ (test)
43.01EM
8
BioASQ Task B 14 2026 challenge edition (sampled 1000 factoid questions)
0.071ECE
7
BioASQ
48.9RSR@5
7
BioASQ
75.7RSR@5
7
BioASQ (50% coverage)
76.13F1 Score
7
BioASQ 20% coverage
85.06F1 Score
7
BIOASQ batches 4 and 5 7 (test)
23.96Snippet MAP
7
BIOASQ batches 4 and 5 7 (test)
16.55Document MAP
7
BioASQ Task B
71.16Precision
6
BioASQ Task B
55.05Strict Score
6
BioASQ Task B
93.51Accuracy
6
BioASQ 9b (test)
72.2Exact F1
6
BioASQ 8b (test)
46.5Exact F1
6
BioASQ (test)
96.4Accuracy
6
Mini-BioASQ RAG-Thief attack
63.4CRR
5
Mini-BioASQ Pirates attack
71CRR
5
BioASQ
90.24Accuracy
5
BioASQ
71.8Accuracy
5