BioASQ
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
BioASQ (test)
51.91MAP
5
BioASQ MRQA few-shot
94.2F1 Score
5
BioASQ 7b (test)
24.07Strict Accuracy
5
BioASQ 6b (test)
79.08Lenient Accuracy
5
BioASQ 5b (test)
88.28Lenient Accuracy
5
BioASQ 4b (test)
0.883Lenient Accuracy
5
BioASQ-factoid Challenge 7h (live runs)
1Batch 1 Score
5
BioASQ (test)
34.3ROUGE-1
4
BioASQ 7b-factoid Batch 5
28.57SACC
4
BioASQ 7b-factoid Batch 4
61.18SACC
4
BioASQ factoid Batch 2 7b
52SACC
4
BioASQ
639Avg Token Consumption
3
BioASQ retrieval
89Precision (NE)
2
BioASQ (test)
8.9Perplexity
2
BioASQ 14b Average across batches
47.99Mean Precision
1
BioASQ 14b (Batch 4)
66.77Mean Precision
1
BioASQ 14b (Batch 3)
47.5Mean Precision
1
BioASQ Batch 2 14b
46.72Mean Precision
1
BioASQ 14b Batch 1
30.96Mean Precision
1
BioASQ Average across batches 14b
38.78Strict Accuracy
1
BioASQ-14b Batch 4
45.45Strict Score
1
BioASQ Batch 3 14b
41.18Strict Score
1
BioASQ-14b Batch 2
25Strict Score
1
BioASQ Batch 1 14b
43.48Strict Accuracy
1
BioASQ Average across batches 14b
91.94Accuracy
1