Concept leakage evaluation on CUB
20.85OISIntCEM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IntCEMEvaluation Protocol=Selective Drop-out CS2026.02 | 20.85 | 80.19 | |
| IntCEMEvaluation Protocol=Random Drop-out CS2026.02 | 18.31 | 76.56 | |
| IntCEM + IB_EEvaluation Protocol=Selective Drop-out CS, Regularization=IB_E2026.02 | 18.04 | 75.75 | |
| IntCEM + IB_BEvaluation Protocol=Selective Drop-out CS, Regularization=IB_B2026.02 | 17.22 | 76.67 | |
| CBM (SJ)Evaluation Protocol=Selective Drop-out CS, Variant=Soft-joint2026.02 | 16.29 | 78.39 | |
| ProbCBMEvaluation Protocol=Selective Drop-out CS2026.02 | 16.01 | 76.92 | |
| CBM (HJ)Evaluation Protocol=Selective Drop-out CS, Variant=Hard-joint2026.02 | 15.71 | 77.02 | |
| CBM (HI)Evaluation Protocol=Selective Drop-out CS, Variant=Hard-independent2026.02 | 14.27 | 74.16 | |
| AR-CBMEvaluation Protocol=Selective Drop-out CS2026.02 | 14.16 | 63.4 | |
| IntCEM + IB_BEvaluation Protocol=Random Drop-out CS, Regularization=IB_B2026.02 | 14.07 | 72.6 | |
| CBM (HI) + IB_BEvaluation Protocol=Selective Drop-out CS, Variant=Hard-independent, Regularization=IB_B2026.02 | 14.01 | 73.16 | |
| CBM (HI) + IB_EEvaluation Protocol=Selective Drop-out CS, Variant=Hard-independent, Regularization=IB_E2026.02 | 14 | 73.13 | |
| IntCEM + IB_EEvaluation Protocol=Random Drop-out CS, Regularization=IB_E2026.02 | 13.98 | 73.89 | |
| ProbCBMEvaluation Protocol=Random Drop-out CS2026.02 | 13.81 | 75.01 | |
| CBM (SJ) + IB_BEvaluation Protocol=Selective Drop-out CS, Variant=Soft-joint, Regularization=IB_B2026.02 | 13.26 | 72.8 | |
| CBM (SJ) + IB_EEvaluation Protocol=Selective Drop-out CS, Variant=Soft-joint, Regularization=IB_E2026.02 | 13.23 | 72.85 | |
| CBM (HJ)Evaluation Protocol=Random Drop-out CS, Variant=Hard-joint2026.02 | 13.1 | 73.09 | |
| ProbCBM + IB_EEvaluation Protocol=Selective Drop-out CS, Regularization=IB_E2026.02 | 13.05 | 73.08 | |
| ProbCBM + IB_BEvaluation Protocol=Selective Drop-out CS, Regularization=IB_B2026.02 | 13.04 | 72.76 | |
| CBM (SJ)Evaluation Protocol=Random Drop-out CS, Variant=Soft-joint2026.02 | 12.97 | 74.19 | |
| CBM (HJ) + IB_BEvaluation Protocol=Selective Drop-out CS, Variant=Hard-joint, Regularization=IB_B2026.02 | 12.67 | 70.86 | |
| CBM (HI) + IB_BEvaluation Protocol=Random Drop-out CS, Variant=Hard-independent, Regularization=IB_B2026.02 | 12.63 | 70.89 | |
| CBM (HI) + IB_EEvaluation Protocol=Random Drop-out CS, Variant=Hard-independent, Regularization=IB_E2026.02 | 12.6 | 70.93 | |
| AR-CBMEvaluation Protocol=Random Drop-out CS2026.02 | 12.58 | 60.86 | |
| CBM (HJ) + IB_EEvaluation Protocol=Selective Drop-out CS, Variant=Hard-joint, Regularization=IB_E2026.02 | 12.47 | 71.09 | |
| CBM (HI)Evaluation Protocol=Random Drop-out CS, Variant=Hard-independent2026.02 | 12.31 | 71.78 | |
| ProbCBM + IB_EEvaluation Protocol=Random Drop-out CS, Regularization=IB_E2026.02 | 11.15 | 71.13 | |
| AR-CBM + IB_EEvaluation Protocol=Selective Drop-out CS, Regularization=IB_E2026.02 | 11.09 | 60.77 | |
| CBM (SJ) + IB_EEvaluation Protocol=Random Drop-out CS, Variant=Soft-joint, Regularization=IB_E2026.02 | 11.03 | 72.03 | |
| AR-CBM + IB_EEvaluation Protocol=Random Drop-out CS, Regularization=IB_E2026.02 | 11.01 | 57.23 | |
| AR-CBM + IB_BEvaluation Protocol=Selective Drop-out CS, Regularization=IB_B2026.02 | 10.96 | 59.66 | |
| CBM (SJ) + IB_BEvaluation Protocol=Random Drop-out CS, Variant=Soft-joint, Regularization=IB_B2026.02 | 10.95 | 71.94 | |
| CBM (HJ) + IB_EEvaluation Protocol=Random Drop-out CS, Variant=Hard-joint, Regularization=IB_E2026.02 | 10.36 | 69.95 | |
| CBM (HJ) + IB_BEvaluation Protocol=Random Drop-out CS, Variant=Hard-joint, Regularization=IB_B2026.02 | 10.32 | 70.38 | |
| ProbCBM + IB_BEvaluation Protocol=Random Drop-out CS, Regularization=IB_B2026.02 | 10.29 | 70.86 | |
| AR-CBM + IB_BEvaluation Protocol=Random Drop-out CS, Regularization=IB_B2026.02 | 10.17 | 56.31 | |
| IntCEMEvaluation Protocol=Complete CS2026.02 | 8.74 | 75.41 | |
| IntCEM + IB_BEvaluation Protocol=Complete CS, Regularization=IB_B2026.02 | 6.15 | 69.96 | |
| IntCEM + IB_EEvaluation Protocol=Complete CS, Regularization=IB_E2026.02 | 6.07 | 71.28 | |
| CBM (SJ)Evaluation Protocol=Complete CS, Variant=Soft-joint2026.02 | 4.69 | 66.25 | |
| CBM (HJ)Evaluation Protocol=Complete CS, Variant=Hard-joint2026.02 | 4.31 | 65.03 | |
| ProbCBMEvaluation Protocol=Complete CS2026.02 | 4.3 | 64.22 | |
| AR-CBMEvaluation Protocol=Complete CS2026.02 | 3.9 | 62.3 | |
| CBM (HI)Evaluation Protocol=Complete CS, Variant=Hard-independent2026.02 | 3.77 | 65.15 | |
| CBM (HI) + IB_EEvaluation Protocol=Complete CS, Variant=Hard-independent, Regularization=IB_E2026.02 | 3.69 | 64.89 | |
| CBM (HI) + IB_BEvaluation Protocol=Complete CS, Variant=Hard-independent, Regularization=IB_B2026.02 | 3.58 | 64.95 | |
| AR-CBM + IB_BEvaluation Protocol=Complete CS, Regularization=IB_B2026.02 | 2.84 | 59.84 | |
| AR-CBM + IB_EEvaluation Protocol=Complete CS, Regularization=IB_E2026.02 | 2.72 | 59.96 | |
| CBM (HJ) + IB_BEvaluation Protocol=Complete CS, Variant=Hard-joint, Regularization=IB_B2026.02 | 2.59 | 60.02 | |
| ProbCBM + IB_EEvaluation Protocol=Complete CS, Regularization=IB_E2026.02 | 2.57 | 59.81 | |
| CBM (HJ) + IB_EEvaluation Protocol=Complete CS, Variant=Hard-joint, Regularization=IB_E2026.02 | 2.56 | 59.52 | |
| ProbCBM + IB_BEvaluation Protocol=Complete CS, Regularization=IB_B2026.02 | 2.43 | 60.29 | |
| CBM (SJ) + IB_BEvaluation Protocol=Complete CS, Variant=Soft-joint, Regularization=IB_B2026.02 | 2.01 | 62.32 | |
| CBM (SJ) + IB_EEvaluation Protocol=Complete CS, Variant=Soft-joint, Regularization=IB_E2026.02 | 2 | 62.31 |