Benchmarks
Task NameDataset NameSOTA ResultTrendResults
REDDIT semi-supervised (test)
86.7F1 Score
10
Reddit (Evolving)
93.92Accuracy
10
Reddit (Non-Evolving)
93.7Accuracy
10
Reddit (test)
100AUROC
10
Reddit γ=5 (OOD)
48.16F1 Score
10
Reddit transductive (test)
99.47AUC-ROC
10
Reddit random negative sampling (inductive)
98.98AP
10
Reddit2 (test)
70.57AUROC (Aleatoric)
10
Reddit
100AUROC
10
REDDIT THR
0.568MCC
10
REDDIT THR.
78.3Accuracy
10
Reddit Human-written paraphrases (test)
0.7Style Score
10
Reddit Machine-written paraphrases (test)
91Style Score
10
Reddit-S (test)
0.02MMD
10
Reddit-C (test)
0.01MMD
10
Reddit (transductive)
70.04AUC-ROC
9
Reddit
88.96MRR
9
Reddit
99.43AP
9
REDDIT-M5
56.73Accuracy
9
REDDIT-12K (10-fold cross validation)
49.03Accuracy
9
REDDIT-B (10-fold cross val)
92.4Accuracy
9
Reddit (test)
0.947Dist-1
9
Reddit short-chain best-of-n sampling
100UUA
8
Reddit medium-chain best-of-n sampling
100UUA
8
Reddit long-chain best-of-n sampling
100UUA
8