Domain Generalization on PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet benchmark leaderboard · SOTA2 Research

Domain Generalization on PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet

99PACS AccuracySIMPLE+

Evaluation Results

Method
SIMPLE+2023.10	99	82.7	87.7	59	61.9	78.1
ERM KAdaptation-MoA-Ensemble2023.10	97.6	83.4	90.9	54.3	63.1	77.9
ERM KAdaptation2023.10	97.5	83	90.3	51.9	62.7	77.1
MIRO+2023.10	97.4	79.9	80.4	58.9	53.8	74.1
ERM KAdaptation-MoA2023.10	97.4	83.1	90.6	52.8	62.7	77.3
ERM LoRA-MoA2023.10	96.9	82.8	89.5	49.2	62.2	75.9
MIRO+SWAD+2023.10	96.8	81.7	83.3	64.3	60.7	77.3
MIRO*2023.10	96.7	82.4	87.3	52.3	50.6	73.9
VL2V-SD2023.10	96.7	83.3	87.4	58.5	62.8	77.7
ERM LoRA, r=22023.10	96.4	82.6	86.7	46.1	61.5	74.7
ERM KAdaptation-MoA2023.10	96.2	83.6	84.5	54.3	59.9	75.7
EoA2023.10	95.8	81.1	83.9	61.1	60.9	76.6
MIRO2023.10	95.6	82.2	82.5	54.3	54	73.7
SMA2023.10	95.5	80.7	82	59.7	60	75.6
VL2V-ADiP2023.10	94.9	81.9	85.7	55.4	59.4	75.5
ERM+SWAD+2023.10	94.7	79.7	80	57.9	53.6	73.2
ERM Compacter2023.10	94.1	81	83	35.9	56.2	70
ERM Attention2023.10	93.8	82	85.9	51.4	57.2	74.1
ERM2023.10	89.6	78.6	71.9	51.4	48.5	68
CADG2022.03	89.1	79.6	79.9	54.2	49.8	70.5
EoA2022.03	88.6	79.1	72.5	52.3	47.4	68
SIMPLE2023.10	88.6	79.9	84.6	57.6	49.2	72
SWAD2022.03	88.1	79.1	70.6	50	46.5	66.9
ERM (Baseline)2023.10	85.8	78.5	78.1	41	52.2	67.1
SEDGE2022.03	84.1	79.8	79.9	56.8	46.3	69.4
ERM+2023.10	83.4	75.9	66.4	35.3	44.4	61.1
random ensemble2022.03	58.1	58.5	59.6	31.5	15.8	44.5