IMDB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
IMDB (test)
0.844AUROC
3
IMDB contrastive (test)
93.9Accuracy
3
IMDB-B
1Runtime (s)
3
IMDB
-13.39Reconstruction LogP
2
IMDb
85.15Convergence Accuracy
2
IMDB full
90.4Accuracy
2
IMDB 2-shot
87.4Accuracy
2
IMDB 1-shot
86.7Accuracy
2
IMDB
7.794Latency
2
IMDB 20 (test)
83.56Accuracy
2
IMDB (test)
82.02Accuracy
2
IMDB out-of-domain (test)
16.85RougeL
2
IMDB (test)
20.61Runtime (s)
2
IMDB (test)
4.37Runtime (s)
2
IMDB
0.293RMSE
2
IMDB (test)
82AUROC
2
IMDB
0.857AUC
1
IMDb (held-out)
5.13Runtime (s/instance)
1
IMDB K=4
91.3Accuracy
1
IMDB
0.321Degree MMD
1
IMDB
0.278Degree MMD
1
IMDB
5.14Latency (µs)
1
IMDB (test)
—Primary metric
0
IMDb (test)
—AUC π-Soft-NS
0
IMDB (test)
—Primary metric
0