Natural shifts
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Natural shifts All-Bins
100I-prop
6
Natural shifts Bin (0.16, 0.319)
52.1Average Improvement
6
Natural shifts Bin (-0.001, 0.16)
27.189Average Improvement
6
Natural shifts Bin (-0.041, -0.001)
18.047Average Improvement
6
Natural shifts Bin (-0.082, -0.041)
25.824Average Improvement
6
Natural shifts All-Bins
0.963Power
4
Natural shifts bin (0.16, 0.319)
0.9Estimation Inaccuracy
4
Natural shifts bin (-0.001, 0.16)
0.5Estimation Inaccuracy
4
Natural shifts bin (-0.041, -0.001)
0.034Estimation Inaccuracy
4
Natural shifts bin (-0.082, -0.041)
1.8Estimation Inaccuracy
4