Domain Generalization on ImageNet Distribution Shifts (Sketch, Adversarial, Rendition, V2) (test)
7,103ImageNet AccCoCoOp + SAMPLe
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CoCoOp + SAMPLeOptimizer=SAMPLe, Protocol=Zero-shot2026.07 | 7,103 | 64.31 | 49 | 51.05 | 77.52 | 60.47 | |
| PromptKD + MERGETUNEBase Method=PromptKD, Model Merging Approach=MERGETUNE2026.01 | 77.14 | 70.21 | 58.97 | 70.68 | 87.22 | 71.77 | |
| PromptKDBase Method=PromptKD, Model Merging Approach=None2026.01 | 77.12 | 69.77 | 58.72 | 70.36 | 87.01 | 71.47 | |
| PromptKD + DAREBase Method=PromptKD, Model Merging Approach=DARE2026.01 | 76.14 | 68.94 | 56.89 | 69.36 | 86.67 | 70.47 | |
| PromptKD + TIESBase Method=PromptKD, Model Merging Approach=TIES2026.01 | 74.63 | 64.22 | 54.85 | 67.47 | 83.85 | 67.6 | |
| KgCoOp + MERGETUNEBase Method=KgCoOp, Model Merging Approach=MERGETUNE2026.01 | 71.8 | 64.7 | 49.1 | 51.01 | 77.02 | 60.46 | |
| HPTYear=20242026.03 | 71.72 | 65.25 | 49.36 | 50.85 | 77.38 | 60.71 | |
| CoOp + MERGETUNEBase Method=CoOp, Model Merging Approach=MERGETUNE2026.01 | 71.68 | 64.56 | 48.67 | 50.74 | 76.61 | 60.15 | |
| CoOpBase Method=CoOp, Model Merging Approach=None2026.01 | 71.51 | 64.2 | 47.99 | 49.71 | 75.21 | 59.28 | |
| CoOpYear=20222026.03 | 71.51 | 64.2 | 47.99 | 49.71 | 75.21 | 59.28 | |
| CoOpOptimizer=Standard, Protocol=Zero-shot2026.07 | 71.51 | 64.2 | 47.99 | 49.71 | 75.21 | 59.28 | |
| HeBAYear=Ours2026.03 | 71.5 | 63.55 | 49.57 | 51.36 | 76.56 | 60.26 | |
| LwEIBYear=20252026.03 | 71.31 | 64.47 | 50.07 | 51 | 77.81 | 60.84 | |
| PromptSRCYear=20232026.03 | 71.27 | 64.35 | 49.55 | 50.9 | 77.8 | 60.65 | |
| TCPOptimizer=Standard, Protocol=Zero-shot2026.07 | 71.2 | 64.6 | 49.5 | 51.2 | 76.73 | 60.51 | |
| TCP + SAMPLeOptimizer=SAMPLe, Protocol=Zero-shot2026.07 | 71.17 | 66 | 50.42 | 52.19 | 78.98 | 61.9 | |
| MMA* + MERGETUNEBase Method=MMA, Model Merging Approach=MERGETUNE, Version=Reproduction2026.01 | 71.11 | 64.41 | 49.26 | 50.43 | 77.51 | 60.4 | |
| CoCoOpYear=20222026.03 | 71.02 | 64.07 | 48.75 | 50.63 | 76.18 | 59.91 | |
| CoCoOpOptimizer=Standard, Protocol=Zero-shot2026.07 | 71.02 | 64.07 | 48.75 | 50.63 | 76.18 | 59.9 | |
| MMAYear=20242026.03 | 71 | 64.33 | 49.13 | 51.12 | 77.32 | 60.48 | |
| CoPrompt + SAMPLeOptimizer=SAMPLe, Protocol=Zero-shot2026.07 | 70.86 | 66.12 | 50.28 | 51.61 | 78.5 | 61.63 | |
| CoPromptOptimizer=Standard, Protocol=Zero-shot2026.07 | 70.8 | 64.25 | 49.43 | 50.5 | 77.51 | 60.42 | |
| MaPLeYear=20232026.03 | 70.72 | 64.07 | 49.15 | 50.9 | 76.98 | 60.27 | |
| MaPLeOptimizer=Standard, Protocol=Zero-shot2026.07 | 70.72 | 64.07 | 49.15 | 50.9 | 76.98 | 60.28 | |
| MaPLe + SAMPLeOptimizer=SAMPLe, Protocol=Zero-shot2026.07 | 70.69 | 65.78 | 50.51 | 52.11 | 77.84 | 61.56 | |
| KgCoOpBase Method=KgCoOp, Model Merging Approach=None2026.01 | 70.66 | 64.1 | 48.97 | 50.69 | 76.7 | 60.11 | |
| CoOp + SAMPLeOptimizer=SAMPLe, Protocol=Zero-shot2026.07 | 70.6 | 64.43 | 49.31 | 50.97 | 77.34 | 60.41 | |
| MMA*Base Method=MMA, Model Merging Approach=None, Version=Reproduction2026.01 | 70.45 | 63.87 | 48.84 | 49.91 | 77.29 | 59.98 | |
| KgCoOp + DAREBase Method=KgCoOp, Model Merging Approach=DARE2026.01 | 69.67 | 62.89 | 47.69 | 50.33 | 76.15 | 59.27 | |
| CoOp + DAREBase Method=CoOp, Model Merging Approach=DARE2026.01 | 69.02 | 61.75 | 45.87 | 49.1 | 73.85 | 57.64 | |
| MMA* + DAREBase Method=MMA, Model Merging Approach=DARE, Version=Reproduction2026.01 | 68.35 | 58.67 | 44.75 | 47.26 | 74.26 | 56.24 | |
| KgCoOp + TIESBase Method=KgCoOp, Model Merging Approach=TIES2026.01 | 67.77 | 61.47 | 46.36 | 49.86 | 75.91 | 58.4 | |
| CLIPYear=20212026.03 | 66.73 | 60.83 | 46.15 | 47.77 | 73.96 | 57.18 | |
| MMA* + TIESBase Method=MMA, Model Merging Approach=TIES, Version=Reproduction2026.01 | 64.01 | 57.13 | 42.32 | 45.23 | 72.11 | 54.2 | |
| CoOp + TIESBase Method=CoOp, Model Merging Approach=TIES2026.01 | 62.84 | 56.26 | 41.14 | 44.65 | 70.77 | 53.2 |