Biomedical Knowledge Probing on MedLAMA Full Set
8Accuracy @ 1CoderBERT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CoderBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 8 | 26.41 | |
| SapBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 7.8 | 30.41 | |
| PubMedBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 5.71 | 24.31 | |
| BlueBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 4.87 | 19.87 | |
| SciBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 3.64 | 18.11 | |
| BioBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 3.28 | 15.46 | |
| UmlsBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 2.94 | 11.64 | |
| BERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 1.95 | 6.96 | |
| ClinicalBERTProbing protocol=CONTRASTIVE-PROBE2021.10 | 1.83 | 8.64 |