Distribution Shift Detection on BROAD (test) benchmark leaderboard · SOTA2 Research

Distribution Shift Detection on BROAD (test)

97.38Novel Classes AUCMDSl

Evaluation Results

Method	Links
MDSl2023.08		97.38	74.75	68.98	83.29	63.41	77.56
VIM2023.08		95.76	56.85	61.01	79.79	68.45	72.37
EBO2023.08		95.52	59.72	65.91	83.83	71.27	75.25
ASH2023.08		95.52	59.72	65.91	83.83	71.27	75.25
REACT2023.08		95.47	60.71	66.03	83.67	71.79	75.53
MAX LOGITS2023.08		95.25	59.73	66.08	83.6	71.63	75.26
ENS-F2023.08		95.08	79.05	75.02	91.57	72.55	82.65
ENS-R2023.08		95	80.79	76.56	92.17	74.79	83.86
ENS-V2023.08		94.97	82.67	78.45	92.76	73.27	84.42
RELATION2023.08		93.61	68.77	65.67	79.95	64.79	74.56
ODIN2023.08		91.73	52.29	62.74	79.68	70.75	71.44
Da2023.08		91.27	58.62	64.95	81.57	72.49	73.78
SHE2023.08		90.98	72.15	67.19	82.38	60.92	74.72
GRADNORM2023.08		90.85	65.17	72.19	85	69.59	76.56
MSP2023.08		90.56	58.45	64.78	78.62	71.93	72.87
MDSall2023.08		89.17	85.64	72.45	95.55	26.06	73.77
VIM2023.08		81.55	62.91	53.26	87	49.01	66.75
ENS-R2023.08		80.42	75.21	62.38	90.56	60.79	73.87
REACT2023.08		79.7	61.46	54.24	89.82	63.91	69.83
ENS-V2023.08		79.42	74.85	60.55	91.08	53.78	71.93
ENS-F2023.08		79.16	69.32	59.89	91.59	61.41	72.27
SHE2023.08		76.71	68.37	63.87	89.79	60.91	71.93
RELATION2023.08		76.06	67.55	57.58	87.8	59.49	69.7
GRADNORM2023.08		75.53	56.52	65.57	89.39	54.45	68.29
DICE2023.08		74.45	58.76	59.43	91.38	59.97	68.8
ASH2023.08		73.89	69.61	57.94	91.13	61.65	70.84
EBO2023.08		73.8	59.59	57.72	91.14	61.55	68.76
MAX LOGITS2023.08		73.67	59.62	57.65	90.87	62.79	68.92
ODIN2023.08		73.58	54.44	61.49	88.52	64.46	68.5
MDSall2023.08		72.66	71.49	60.89	89.42	30.01	64.89
MDSl2023.08		72.32	68.91	55.41	75.24	38.92	62.16
Da2023.08		67.95	61.44	55.65	87.43	67.12	67.92
MSP2023.08		67.25	61.17	55.59	86.71	67.52	67.65
CADET Min2023.08		66.79	62.4	55.65	87.15	56.88	65.77
MDSf2023.08		63.52	55.04	56.18	76.52	36.81	57.61
DICE2023.08		55.7	78.29	77.84	86.67	61.23	71.95
MDSf2023.08		53.35	67.73	54.92	31.47	63.43	54.18
LOGITS NORM2023.08		52.62	51.82	59.47	82.81	48.05	58.95
LOGITS NORM2023.08		51.93	37.39	38.25	39.99	36.32	40.78
CADET Min2023.08		20.91	67.12	59.82	79.67	54.24	56.35