IMDB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
IMDb (test)
15.58NMI
9
IMDB-B 1-shot
62.25Accuracy
8
IMDB-Multi Fair setup
51.6Accuracy
8
IMDB-Binary Fair setup
76.1Accuracy
8
IMDB
42.7Human Win Rate
8
IMDb BERT-base (test)
88.29Mean Accuracy (ε=0.5)
8
IMDb
87.36Accuracy
8
IMDB BINARY
70.25AUC
8
IMDb
1.3Generalization Gap (Δ)
8
IMDb
53.5Precision
8
IMDB
1Approximation Ratio
8
IMDB
1Approximation Ratio
8
IMDB FTC-metadataset mini 10%
0.125NLL
8
IMDB FTC-metadataset mini 10%
98.91AUROC
8
IMDB FTC-metadataset full
98.59AURAC Score
8
IMDB FTC-metadataset full
0.097NLL
8
IMDB FTC-metadataset full
1.099Avg Prediction Set Size
8
IMDB FTC-metadataset mini 10% 1.0 (test)
0.982AURAC Score
8
IMDB @512 (test)
81.3Accuracy
8
IMDb Custom
77.62Precision
8
IMDb-Custom
92.18Accuracy
8
IMDB-B
68.6Accuracy
8
IMDB62 (test)
96Weighted F1
8
IMDB Counterfactual
85.38Accuracy
8
IMDB (Contrast)
77.8Accuracy
8