Benchmarks
Task NameDataset NameSOTA ResultTrendResults
REDDIT Binary (85/15 stratified train-test split)
78.45Accuracy
7
Reddit (test)
71.8R@1 (R100)
7
Reddit (test)
1.682NLL
7
Reddit
87.92NMI
6
Reddit
4.24HV
6
Reddit2000
2,543.924Objective Value
6
Reddit1500
1,200.663Objective Value
6
Reddit dataset
74.08Accuracy
6
Reddit (test)
4.49Precision@5
6
Reddit-S
11.94Runtime (s)
6
Reddit C
6.13Runtime (s)
6
REDDIT-BINARY (test)
92.4Accuracy (Clean)
6
Reddit
-0.142Best FID+
6
Reddit-Dialogues
0.025Unattacked Avg |PS|
6
Reddit
0.057Cohesiveness
6
Reddit Casual
88Average Fluency
6
Reddit (test)
0.842Accuracy
6
Reddit (test)
8.906Perplexity
6
Reddit (test)
24.8ROUGE-1
6
Reddit (inductive)
97.04Accuracy
6
Reddit
96.33Accuracy (0% Ptb)
6
Reddit queries (test)
76.4AUC
6
Reddit
17AUPRC
5
Reddit
93Accuracy
5
Reddit
4.3End-to-end Latency (s)
5