Pubmed
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PubMed synthetic data (non-IID)
75.6Accuracy
12
PubMed synthetic data non-IID
81.52Accuracy
12
Pubmed
0.258Faithfulness (KL distance)
12
PubMed
50.7Accuracy
12
Pubmed (3% labeling ratio)
61.08Explainability Score
12
Pubmed (2% labeling ratio)
61.42Explainability Performance
12
PubMed OOD from The Pile
12.61Perplexity
12
Pubmed (100 random dataset splits)
79.21Accuracy
12
PubMed Pythia (train)
67.3TPR@1%FPR
12
PubMed
1.3Running Time (s)
12
Pubmed
20.05Brier Score
12
Pubmed
0.98ECE
12
Pubmed original
74Accuracy
12
Pubmed public (test)
81.6Accuracy
12
PubMed n-ary relation extraction
85.6Accuracy (B-Cross)
12
PUBMED
90.33Accuracy (%)
11
PubMed (Metis splitting)
83.9Accuracy
11
PubMed (Louvain splitting)
85Accuracy
11
PubMed
0.31ROUGE-1
11
Pubmed
44.73MRR
11
Pubmed 20-shot
89.98Accuracy
11
PubMed
0.09Running Time (s)
11
PubMed 1-shot (test)
53.54Accuracy
11
PubMed
40.6NMI
11
Pubmed Planetoid (standard)
81.29HR@100
11