Banking77
Benchmarks
TaskDatasetSOTA resultTrendResults
Banking77
894.8Accuracy
260
Banking77 (test)
91.55Accuracy
196
Banking77 (test)
79.62Macro F1
49
BANKING77 Dir(0.01) (test)
85.98Accuracy
45
BANKING77 5-shot (test)
79.09Accuracy
20
BANKING77 10-shot
87.95Accuracy
20
BANKING77 Dir(0.1) (test)
92.14Accuracy
17
BANKING77 Dir(0.5) (test)
93.35Accuracy
17
BANKING77 10-shot (test)
82.66Accuracy
12
Banking77 (B77) r=2.5% contamination (test)
0.818AUC2 (10% Subset)
12
BANKING77 5-shot
78.9Accuracy
11
Banking77
0.7ARI
10
BANKING77 75% known ratio
84.4Accuracy
8
BANKING77 50% known ratio
83.78Accuracy
8
BANKING77 25% known ratio
85.71Accuracy
8
Banking77 (dev)
100Coverage
7
Banking77 ncal=6,468, delta=0.10, simulated confidence scores (test)
90.6Accuracy (alpha=0.15)
7
Banking77
0.705Purity
7
Banking77 ClusteringS2S
0.3Accuracy
6
Banking77-OOS (test)
83.3AUC^2 (10%)
6
Banking77 1.0 (train)
93.8Accuracy
6
Banking77 30 samples 1.0 (train)
0.906Accuracy
6
Banking77 10 samples 1.0 (train)
85.19Accuracy
6
Banking77
91.2F1-Macro
5
Banking77 (val)
87.2Macro F1 Score
4