List your company
ResearchFormerly WizWand

Biomedical Knowledge Probing on MedLAMA Full Set 1.0

0.0571Acc@1Contrastive-Probe
-0.0017640.0135180.02880.044082Oct 15, 2021
Updated 8mo ago

Evaluation results

MethodLinks
Contrastive-ProbePLM=PubMedBERT2021.100.05710.2431
Contrastive-ProbePLM=BlueBERT2021.100.04870.1987
Contrastive-ProbePLM=BioBERT2021.100.03280.1546
Contrastive-ProbePLM=BERT2021.100.01950.0696
X-FACTR (Confidence)PLM=BlueBERT2021.100.0074—
Generative PLMsPLM=T5-small2021.100.0070.0172
Generative PLMsPLM=SciFive-large2021.100.00550.0203
Generative PLMsPLM=SciFive-base2021.100.00530.0202
X-FACTR (Order+Order)PLM=BlueBERT2021.100.005—
Mask averagePLM=BioBERT2021.100.00280.0303
X-FACTR (Confidence)PLM=BioBERT2021.100.0017—
Generative PLMsPLM=BART-base2021.100.00160.0139
X-FACTR (Order+Order)PLM=BioBERT2021.100.0011—
Generative PLMsPLM=T5-base2021.100.00060.0019
X-FACTR (Order+Order)PLM=BERT2021.100.0006—
Mask averagePLM=BERT2021.100.00060.0073
X-FACTR (Confidence)PLM=BERT2021.100.0005—
Mask averagePLM=BlueBERT2021.100.00050.0139