Pubmed
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PubMed
89.7Accuracy
45
PubMed (test)
73.6Accuracy
45
PubMed semi-supervised
82.98Accuracy
42
PubMed
42.33Next Token Accuracy
40
PubMed 10-shot
92.77Accuracy
40
PubMed
85.03Mean Accuracy
38
PubMed (test)
73.54Macro-F1
37
PubMed 0.1% labels
76.5Accuracy
37
PubMed 0.03% labels
71.1Accuracy
37
PubMed (random)
83.8Accuracy
37
PubMed
0.499Silhouette Width
36
Pubmed
0ASR
36
PubMed
76.6AUC
36
PubMed Pythia
97ROC AUC
36
Pubmed
0.031ECE
36
PubMed 0.05% labels
73.2Accuracy
36
PubMed standard (fixed split)
80.4Accuracy
33
PubMed (GU)
0ASR
32
PubMed 5-shot
91.85Accuracy
32
PubMed (test)
61.49ROUGE-1
32
PubMed
924.9Avg Communities
31
Pubmed (48/32/20)
90.26Mean Accuracy
31
Pubmed (60/20/20 random split)
91.99Accuracy
31
Pubmed
84.55Original Accuracy
30
Pubmed zero-shot
41.35Perplexity
30