Snippet Retrieval on BIOASQ 7 (test batches 1-5)
0.2518MAPOracle
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OracleParams=02021.06 | 0.2518 | 0.4114 | |
| BJPDRMM-ADAPT-NFParams=3.5M, Adaptive Embedding=true, fine-tuning=false2021.06 | 0.1735 | 0.1966 | |
| BJPDRMMParams=88.5M2021.06 | 0.1682 | 0.1957 | |
| JBERT-ADAPT-NFParams=6.3K, Adaptive Embedding=true, fine-tuning=false2021.06 | 0.1653 | 0.1964 | |
| JBERTParams=85M2021.06 | 0.1629 | 0.1987 | |
| JBERT-ADAPTParams=85M, Adaptive Embedding=true2021.06 | 0.1599 | 0.1987 | |
| JBERT-NFParams=6.3K, fine-tuning=false2021.06 | 0.1599 | 0.1964 | |
| BJPDRMM-NFParams=3.5M, fine-tuning=false2021.06 | 0.1577 | 0.1795 | |
| JPDRMMParams=5.79k2021.06 | 0.1572 | 0.1883 | |
| BJPDRMM-ADAPTParams=88.5M, Adaptive Embedding=true2021.06 | 0.157 | 0.1938 | |
| BERT+PDRMMParams=109.5M2021.06 | 0.0963 | 0.193 | |
| PDRMM+PDRMMParams=11.39k2021.06 | 0.0916 | 0.1843 | |
| Sentence PDRMMParams=5.68K2021.06 | 0.0873 | 0.1857 | |
| BERT+BCNNParams=109.5M2021.06 | 0.0607 | 0.1305 | |
| PDRMM+BCNNParams=21.83k2021.06 | 0.0567 | 0.1243 | |
| BM25+BM25Params=42021.06 | 0.0429 | 0.0493 |