Failure Probability Estimation on MNIST 100 seeds (held-out)
4.016Mean p_fCentroid Rot 30°
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Centroid Rot 30°queries=685,000, runtime (s)=4432026.06 | 4.016 | 1.47 | 4.83 | 24 | 1 | |
| Centroid Rot 90°queries=667,040, runtime (s)=4322026.06 | 4.025 | 1.14 | 4.94 | 33 | 1 | |
| OCSVM Contrastqueries=670,940, runtime (s)=4342026.06 | 4.027 | 1.29 | 4.89 | 35 | 2 | |
| Mahalanobis Badqueries=714,960, runtime (s)=4632026.06 | 4.029 | 1.48 | 4.83 | 20 | 0 | |
| OCSVM Badqueries=660,820, runtime (s)=4282026.06 | 4.031 | 1.21 | 4.92 | 37 | 0 | |
| Traditional SSqueries=447,160, runtime (s)=2892026.06 | 9.636 | 5.72 | 2.24 | 70 | 0 |