Accuracy Estimation on Nonliving-26 Subpopulation Shift
0.982R2COT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| COTModel=ResNet182024.05 | 0.982 | 0.992 | |
| MANOModel=ResNet182024.05 | 0.978 | 0.991 | |
| MANOModel=WRN-50-22024.05 | 0.978 | 0.992 | |
| MANOModel=ResNet502024.05 | 0.975 | 0.995 | |
| NuclearModel=ResNet182024.05 | 0.97 | 0.989 | |
| COTModel=ResNet502024.05 | 0.962 | 0.984 | |
| COTModel=WRN-50-22024.05 | 0.962 | 0.979 | |
| NuclearModel=WRN-50-22024.05 | 0.96 | 0.988 | |
| DispersionModel=ResNet182024.05 | 0.958 | 0.981 | |
| NuclearModel=ResNet502024.05 | 0.956 | 0.985 | |
| ATCModel=WRN-50-22024.05 | 0.945 | 0.969 | |
| ProjNormModel=ResNet182024.05 | 0.939 | 0.978 | |
| ConfScoreModel=WRN-50-22024.05 | 0.932 | 0.971 | |
| MDEModel=ResNet182024.05 | 0.929 | 0.989 | |
| ProjNormModel=WRN-50-22024.05 | 0.924 | 0.973 | |
| RotationModel=WRN-50-22024.05 | 0.917 | 0.977 | |
| RotationModel=ResNet502024.05 | 0.916 | 0.97 | |
| FréchetModel=ResNet182024.05 | 0.914 | 0.98 | |
| EntropyModel=WRN-50-22024.05 | 0.912 | 0.959 | |
| MDEModel=WRN-50-22024.05 | 0.909 | 0.991 | |
| MDEModel=ResNet502024.05 | 0.907 | 0.993 | |
| RotationModel=ResNet182024.05 | 0.906 | 0.955 | |
| ATCModel=ResNet502024.05 | 0.893 | 0.96 | |
| DispersionModel=WRN-50-22024.05 | 0.893 | 0.939 | |
| FréchetModel=WRN-50-22024.05 | 0.885 | 0.942 | |
| ProjNormModel=ResNet502024.05 | 0.873 | 0.972 | |
| ATCModel=ResNet182024.05 | 0.854 | 0.939 | |
| FréchetModel=ResNet502024.05 | 0.848 | 0.95 | |
| ConfScoreModel=ResNet502024.05 | 0.832 | 0.942 | |
| DispersionModel=ResNet502024.05 | 0.805 | 0.907 | |
| ConfScoreModel=ResNet182024.05 | 0.781 | 0.925 | |
| EntropyModel=ResNet502024.05 | 0.776 | 0.918 | |
| EntropyModel=ResNet182024.05 | 0.739 | 0.909 | |
| AgreeScoreModel=WRN-50-22024.05 | 0.676 | 0.861 | |
| AgreeScoreModel=ResNet502024.05 | 0.638 | 0.837 | |
| AgreeScoreModel=ResNet182024.05 | 0.543 | 0.81 |