Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Reddit
5.44AUPRC
4
Reddit
3.89AUPRC
4
Reddit E → N v1
0.595AUROC
4
Reddit N → E v1
0.597AUROC
4
REDDIT-M-5K (test)
787.48Avg Cut Size
4
REDDIT-M-12K (test)
568.91Avg Cut Size
4
Reddit (test)
0.4Tokenised WER
4
Reddit (test)
70.1F1 Score
4
Reddit (dev)
69.6F1 Score
4
Reddit (test)
40Precision
4
Reddit
52Win Rate vs GT
3
REDDIT
-0.95Deviation (%)
3
Reddit-M
65.26NMI
3
Reddit
4.4Peak Memory Usage (GB)
3
Reddit 'Get it #OffMyChest' (test)
85.55Accuracy
3
REDDIT-12K
52Runtime (s)
3
REDDIT-5K
16Runtime (s)
3
Reddit (public)
94.89Overall Accuracy
2
Reddit
10Number of Significant Features (S)
2
Reddit-Binary
-0.072Best FID+
2
reddit
38ARI
2
reddit
0.521AMI
2
Reddit (test)
0.8GPT-4 Score
2
Reddit
0.31NLL
2
Reddit (randomly selected 25 examples)
3.47Relevance
2