Wiki
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
WIKI
84.5Micro F1
8
Wiki (test)
0.48Kendall's τ (Fit)
8
Wiki csai
87.9AUROC
7
Wiki-PPL
11.72Wiki-PPL
7
Wiki Sure Only (S) (test)
94.8F1 Score
7
Wiki non-homophilous large-scale (test)
61.85Accuracy
7
Wiki-ZSL m=15 (test)
67.31Precision (%)
7
Wiki ZSL m=5 (test)
78.19Precision
7
Wiki (test)
7.554NLL
7
Wiki (test)
-1.364NLL
7
Wiki 18 20M-scale file-per-document (50-query samples)
62NQ Score
6
wiki
171.5010.5-Risk Accuracy
6
wiki
174.0760.9-Risk Accuracy
6
wiki
0.652RRMSE
6
wiki (test)
0.108Energy Score (ES)
6
Wiki en 21
0.106Runtime (s)
6
wiki-en21
80,000Operations Needed
6
Wiki Length 12 (test)
0.041MAE
6
Wiki Length 9 (test)
0.041MAE
6
Wiki Length 6 (test)
0.041MAE
6
Wiki Length 3 (test)
0.04MAE
6
Wiki ZSL
42.13Micro-F1
6
Wiki
0.57Doc Fit (Adv Prob)
6
Wiki (test)
-0.316ΔCHE
5
Wiki
5.03Epochs per Second
5