Questions
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
questions
0.97ROC AUC
161
Questions (test)
80.02AUROC
97
Questions
98.2Accuracy
79
Questions
26.8AUPRC
59
Questions non-overlapping subgraph partitioning
69.73AUC
45
Questions overlapping subgraph partitioning
69.39AUC
39
2,000 questions dataset
0.029ECE
21
Questions v1 (test)
80.49AUC
20
Questions
71.3Mean AUROC
18
Questions
54.3Mean macro-F1
18
questions (10%/10%/80% split)
22.76AP
18
Questions non-overlapping subgraph partitioning (10 Clients)
68.69AUC
13
Questions
74.15F1-macro
13
Questions
59.45F1-macro
13
Questions
87.51AUROC
13
Questions
0.739AUROC
13
Questions (test)
5.12AP
11
Questions heterophilic graphs (test)
79.36Accuracy
9
Questions
14.15Perplexity
8
Questions 95% (test)
77.11ROC-AUC
8
Questions (test)
80.14ROC AUC
7
100 questions cross-model comparison
41.2F1 Score
6
519 questions full scale
47.2F1 Score
4
Questions heterophilic (test)
80.49AUC
4
Questions
53.44F1 Macro
4