Image Classification on ImageNet OOD variants (A, V2, R, S) 1k (test val) benchmark leaderboard · SOTA2 Research

Image Classification on ImageNet OOD variants (A, V2, R, S) 1k (test val)

77.87Top-1 Acc (ImageNet)DPE

Evaluation Results

Method	Links
DPE2024.10		77.87	61.09	70.83	89.18	66.33	73.06	71.86
TDA2024.10		76.28	61.27	68.42	88.41	64.67	71.81	70.69
DiffTPT + CoOp2024.10		75	58.09	66.8	73.9	49.5	64.12	61.97
OpenCLIP2024.10		74.04	53.88	67.69	87.42	63.18	69.31	68.13
DPE + CoOp2024.10		73.67	59.43	66.38	78.49	50.78	65.75	63.77
TPT + CoOp2024.10		73.61	57.95	66.83	77.27	49.29	64.99	62.83
DPE2024.10		71.91	59.63	65.44	80.4	52.26	65.93	64.43
CoOp2024.10		71.51	49.71	64.2	75.21	47.99	61.72	59.28
DiffTPT2024.10		70.3	55.68	65.1	75	46.8	62.28	60.52
TDA2024.10		69.51	60.11	64.67	80.24	50.54	65.01	63.89
TPT2024.10		68.98	54.77	63.45	77.06	47.94	62.44	60.81
Ensemble2024.10		68.34	49.89	61.88	77.65	48.24	61.2	59.42
CLIP2024.10		66.73	47.87	60.86	73.98	46.09	59.11	57.2
DPE + CoOp2024.10		64.86	30.08	57.96	59.78	37.8	50.1	46.41
TPT + CoOp2024.10		64.73	30.32	57.83	58.99	35.86	49.55	45.75
DiffTPT + CoOp2024.10		64.7	32.96	61.7	58.2	36.8	50.87	47.42
DPE2024.10		63.41	30.15	56.72	63.72	40.03	50.81	47.66
CoOp2024.10		63.33	23.06	55.4	56.6	34.67	46.61	42.43
TDA2024.10		61.35	30.29	55.54	62.58	38.12	49.58	46.63
DiffTPT2024.10		60.8	31.06	55.8	58.8	37.1	48.71	45.69
TPT2024.10		60.74	26.67	54.7	59.11	35.09	47.26	43.89
Ensemble2024.10		59.81	23.24	52.91	60.72	35.48	46.43	43.09
CLIP2024.10		58.16	21.83	51.41	56.15	33.37	44.18	40.69