meps
Benchmarks
TaskDatasetSOTA resultTrendResults
MEPS (test)
0.81Oracle ECE
150
MEPS
83.84AUC
19
meps 21 (test)
1.795Average Length
18
meps19 (test)
90Marginal Coverage
14
MEPS
-0.553ΔDP
13
MEPS
0INFD
12
meps 19 (test)
5.507Max Cond. Coverage Deviation
10
MEPS outliers 19 (test)
92Mean Outlier Coverage
7
meps19
61.77SMIS
7
meps 19 (test)
13Conditional Large-Loss Rate
6
meps
0.75AUROC
6
MEPS Panel 21 2017 (test)
242Length
6
MEPS Panel 20 2017 (test)
19,050Length
6
MEPS Panel 19 2017 (test)
240.5Length
6
MEPS (test)
3.113Median Excess Test Loss
5
MEPS 2015 Panel 19
97.59Accuracy
5
Meps-21
91Empirical Coverage
4
Meps 20
90Empirical Coverage
4
Meps 19
90Empirical Coverage
4
meps 21 (test)
7.832Max Conditional Coverage Deviation
4
meps 20 (test)
6.998Max Conditional Coverage Deviation (%)
4
meps-20 (test)
1.836Average Length
4
meps 19 (test)
1.685Average Length
4
MEPS-20
0.91Cmarg
3
MEPS 2019 (calibration (500 samples))
32.08Interval Width
3