Distribution Shift Detection on BROAD (test)

97.38Novel Classes AUCMDSl

Evaluation results

Method
MDSl2023.08	97.38	74.75	68.98	83.29	63.41	77.56
VIM2023.08	95.76	56.85	61.01	79.79	68.45	72.37
EBO2023.08	95.52	59.72	65.91	83.83	71.27	75.25
ASH2023.08	95.52	59.72	65.91	83.83	71.27	75.25
REACT2023.08	95.47	60.71	66.03	83.67	71.79	75.53
MAX LOGITS2023.08	95.25	59.73	66.08	83.6	71.63	75.26
ENS-F2023.08	95.08	79.05	75.02	91.57	72.55	82.65
ENS-R2023.08	95	80.79	76.56	92.17	74.79	83.86
ENS-V2023.08	94.97	82.67	78.45	92.76	73.27	84.42
RELATION2023.08	93.61	68.77	65.67	79.95	64.79	74.56
ODIN2023.08	91.73	52.29	62.74	79.68	70.75	71.44
Da2023.08	91.27	58.62	64.95	81.57	72.49	73.78
SHE2023.08	90.98	72.15	67.19	82.38	60.92	74.72
GRADNORM2023.08	90.85	65.17	72.19	85	69.59	76.56
MSP2023.08	90.56	58.45	64.78	78.62	71.93	72.87
MDSall2023.08	89.17	85.64	72.45	95.55	26.06	73.77
VIM2023.08	81.55	62.91	53.26	87	49.01	66.75
ENS-R2023.08	80.42	75.21	62.38	90.56	60.79	73.87
REACT2023.08	79.7	61.46	54.24	89.82	63.91	69.83
ENS-V2023.08	79.42	74.85	60.55	91.08	53.78	71.93
ENS-F2023.08	79.16	69.32	59.89	91.59	61.41	72.27
SHE2023.08	76.71	68.37	63.87	89.79	60.91	71.93
RELATION2023.08	76.06	67.55	57.58	87.8	59.49	69.7
GRADNORM2023.08	75.53	56.52	65.57	89.39	54.45	68.29
DICE2023.08	74.45	58.76	59.43	91.38	59.97	68.8
ASH2023.08	73.89	69.61	57.94	91.13	61.65	70.84
EBO2023.08	73.8	59.59	57.72	91.14	61.55	68.76
MAX LOGITS2023.08	73.67	59.62	57.65	90.87	62.79	68.92
ODIN2023.08	73.58	54.44	61.49	88.52	64.46	68.5
MDSall2023.08	72.66	71.49	60.89	89.42	30.01	64.89
MDSl2023.08	72.32	68.91	55.41	75.24	38.92	62.16
Da2023.08	67.95	61.44	55.65	87.43	67.12	67.92
MSP2023.08	67.25	61.17	55.59	86.71	67.52	67.65
CADET Min2023.08	66.79	62.4	55.65	87.15	56.88	65.77
MDSf2023.08	63.52	55.04	56.18	76.52	36.81	57.61
DICE2023.08	55.7	78.29	77.84	86.67	61.23	71.95
MDSf2023.08	53.35	67.73	54.92	31.47	63.43	54.18
LOGITS NORM2023.08	52.62	51.82	59.47	82.81	48.05	58.95
LOGITS NORM2023.08	51.93	37.39	38.25	39.99	36.32	40.78
CADET Min2023.08	20.91	67.12	59.82	79.67	54.24	56.35