BioASQ
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BioASQ
81.13AUROC
104
BioASQ
98.32Accuracy
72
BioASQ
88.67Accuracy
63
BioASQ
84AUROC
32
BioASQ
0.274E-AURC
28
BioASQ (dev)
77.8F1 Score
28
BioASQ out-of-domain
91.87Accuracy
25
BioASQ (test)
77.51AUROC
20
BioASQ
70.46AUROC
20
BioASQ (test)
54.89BBH
20
BioASQ-B
40.6EM
18
BioASQ (test)
47.27EM
16
BIOASQ 7 (test batches 1-5)
0.252MAP
16
BIOASQ 7 (test batches 1-5)
19.24MAP
16
BioASQ MRQA out-of-domain evaluation 2019 (test)
60.3EM
15
BioASQ-ENKB5
90.99ID Score
14
BioASQ
45.68EM
14
BioASQ
66T Score
14
BioASQ MRQA out-of-domain
67.62EM
14
BioASQ factoid 7b (test)
47.4SAcc
13
BioASQ
5,351Inference Throughput (Samples/sec)
12
BioASQ MRQA
91F1 Score
12
BioASQ
29Factoid Acc
11
BioASQ
26.1F1 Score
10
BioASQ
85.71SAME_CONCLUSION Score
10