Classification Calibration
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
0.81Oracle ECE
150
May 12, 2026
6.777D-ECE
26
May 8, 2026
13.44Classwise ECE
14
Apr 10, 2026
0.044ECE (Mean)
13
Feb 26, 2026
3.645D-ECE
7
May 8, 2026
2.31ACE
7
Feb 26, 2026
-4.3Calibration Delta (Female non-white)
4
Jun 12, 2026
0.49ΔNLL (%)
1
May 26, 2026
16Delta NLL (%)
1
May 26, 2026
0.76∆ NLL (%)
1
May 26, 2026
0.16Delta NLL
1
May 26, 2026
17Delta NLL (%)
1
May 26, 2026
1.55Delta NLL (%)
1
May 26, 2026