Pubmed
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Pubmed (production)
74.88Accuracy
3
PubMed 200k (test)
93.9F1 Score
3
PubMed 20k (test)
92.6F1 Score
3
Pubmed
0.002Inference Time (sec)
3
PubMed full graph (test)
10.3k value (0.05)
2
Pubmed r=1%
11.5Time (s)
2
PubMed Low Consistency (score_cons < 0.73)
72.8Coverage
2
PubMed Low Coverage (score_cov < 0.60)
72.7Coverage
2
PubMed All Summaries
72.5Coverage
2
PubMed
0.68Accuracy
2
PubMed
1.62Coverage Size (alpha=0.05)
2
PubMed
0.373Average running time (s)
2
PubMed
42.13Content Coverage
2
PubMed Imbalanced largest connected component (LCC)
77.3Accuracy
2
PUBMED
81.6Avg Accuracy
2
Pubmed 50% hidden nodes
0.922AUC
2
Pubmed 10% hidden nodes
93AUC
2
PubMed Biomedical 1,000 papers randomly sampled
42Top-3 Accuracy
1
pubmed
12Speedup
1
PubMed
0.001Cosine Similarity
1
Pubmed standard (test)
0.147P-Value
1
PubMed20k Report standard (test)
83.59Accuracy
1
PubMed (val)
49.01Perplexity (PPL)
1
PubMed Planetoid original (test)
—Primary metric
0
PUBMED
—Primary metric
0