Document Retrieval on BIOASQ 7 (test batches 1-5)
19.24MAPOracle
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OracleParams=02021.06 | 19.24 | 72.67 | |
| BERT+BCNNParams=109.5M2021.06 | 8.79 | 55.73 | |
| BERT+PDRMMParams=109.5M2021.06 | 8.79 | 55.73 | |
| JBERTParams=85M2021.06 | 7.93 | 53.44 | |
| JBERT-NFParams=6.3K, fine-tuning=false2021.06 | 7.9 | 52.78 | |
| JBERT-ADAPT-NFParams=6.3K, Adaptive Embedding=true, fine-tuning=false2021.06 | 7.84 | 53.18 | |
| JBERT-ADAPTParams=85M, Adaptive Embedding=true2021.06 | 7.81 | 52.94 | |
| BJPDRMMParams=88.5M2021.06 | 7.59 | 52.21 | |
| PDRMM+BCNNParams=21.83k2021.06 | 7.47 | 52.97 | |
| PDRMM+PDRMMParams=11.39k2021.06 | 7.47 | 52.97 | |
| BJPDRMM-ADAPT-NFParams=3.5M, Adaptive Embedding=true, fine-tuning=false2021.06 | 7.42 | 52.12 | |
| BJPDRMM-ADAPTParams=88.5M, Adaptive Embedding=true2021.06 | 6.93 | 48.77 | |
| BM25+BM25Params=42021.06 | 6.86 | 48.65 | |
| BJPDRMM-NFParams=3.5M, fine-tuning=false2021.06 | 6.84 | 48.81 | |
| JPDRMMParams=5.79k2021.06 | 6.69 | 53.68 | |
| Sentence PDRMMParams=5.68K2021.06 | 6.39 | 48.6 |