Benchmarks

Task NameDataset NameSOTA ResultTrendResults

Visual Language Model IP Protection

Office-Home 65 (Art)

52Wua

Semi-supervised Domain Adaptation

Office-Home (target)

72.3Closed-set Accuracy (CS)

Image Classification

Office-Home Open (test)

83.4Accuracy (Art)

Multi-Target Partial Domain Adaptation

Office-Home

73.1Score A

Partial Domain Adaptation

Office-Home Product to Real World 5% labeled ratio partial setting

-12CNG

Partial Domain Adaptation

Office-Home Clipart to Real World 5% labeled ratio partial setting

-4.9CNG

Partial Domain Adaptation

Office-Home Ar -> Rw (5% labeled ratio) partial setting (Ar65 -> Rw25)

-14.6CNG

Transferability Estimation

Office-Home

0.89Pearson Correlation

Domain Adaptation

Office-Home

71.6Accuracy (Covariate Shift, Closed-set)

Generalized Domain Adaptation Few-Shot Open-Set Recognition

Office-Home Real-World to Clipart (meta-test)

49.24Accuracy

Unsupervised Domain Adaptation

Office-Home 0.8/0.2 source split

79.7Acc Cl -> Ar (S)

Domain Generalization

Office-Home (train+val)

59.37Art Accuracy

Transfer Learning

Office-Home

63.3Accuracy

Multi-Target Domain Adaptation

Office-Home

84.1Accuracy (Ar)

Source-Free Multi-Source Domain Adaptation

Office-Home

91.1Accuracy (Rw)

Domain Adaptation

Office-Home (target)

50.45Accuracy (Art->Clipart)

Domain Adaptation

Office-Home Rw -> Pr

82.95Overall Accuracy

Domain Adaptation

Office-Home Rw -> Cl

65.71Overall Accuracy

Domain Adaptation

Office-Home Rw -> Ar

70.13Overall Accuracy

Domain Adaptation

Office-Home Ar -> Rw

76.7Overall Accuracy

Domain Adaptation

Office-Home Source and Target

83.6Source Accuracy

Image Classification

Office-Home 28

58.42Accuracy (Art)

Image Classification

Office-Home (global test)

77.2Accuracy