Concept leakage evaluation on aPY
16.06OISProbCBM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProbCBMConcept Shift Scenario=Selective Drop-out CS2026.02 | 16.06 | 76.98 | |
| IntCEMConcept Shift Scenario=Selective Drop-out CS2026.02 | 14.74 | 74.24 | |
| AR-CBMConcept Shift Scenario=Selective Drop-out CS2026.02 | 14.17 | 63.42 | |
| ProbCBMConcept Shift Scenario=Random Drop-out CS2026.02 | 13.78 | 74.94 | |
| ProbCBM + IBBConcept Shift Scenario=Selective Drop-out CS2026.02 | 13.02 | 73.15 | |
| AR-CBMConcept Shift Scenario=Random Drop-out CS2026.02 | 12.62 | 60.85 | |
| IntCEMConcept Shift Scenario=Random Drop-out CS2026.02 | 12.24 | 72.31 | |
| CBM (SJ)Concept Shift Scenario=Selective Drop-out CS2026.02 | 11.23 | 70.4 | |
| ProbCBM + IBBConcept Shift Scenario=Random Drop-out CS2026.02 | 11.17 | 71.23 | |
| AR-CBM + IBBConcept Shift Scenario=Selective Drop-out CS2026.02 | 11.04 | 60.92 | |
| AR-CBM + IBBConcept Shift Scenario=Random Drop-out CS2026.02 | 11 | 57.19 | |
| IntCEM + IBBConcept Shift Scenario=Random Drop-out CS2026.02 | 10.99 | 68.91 | |
| CBM (SJ)Concept Shift Scenario=Random Drop-out CS2026.02 | 10.72 | 70.73 | |
| CBM (HJ)Concept Shift Scenario=Selective Drop-out CS2026.02 | 10.17 | 67.54 | |
| IntCEM + IBBConcept Shift Scenario=Selective Drop-out CS2026.02 | 9.86 | 68.04 | |
| CBM (HJ) + IBBConcept Shift Scenario=Selective Drop-out CS2026.02 | 9.78 | 64.38 | |
| CBM (SJ) + IBBConcept Shift Scenario=Selective Drop-out CS2026.02 | 9.56 | 68.03 | |
| CBM (HJ)Concept Shift Scenario=Random Drop-out CS2026.02 | 9.44 | 70.78 | |
| CBM (HJ) + IBBConcept Shift Scenario=Random Drop-out CS2026.02 | 9.35 | 69.7 | |
| CBM (HI)Concept Shift Scenario=Selective Drop-out CS2026.02 | 9.19 | 64.26 | |
| CBM (SJ) + IBBConcept Shift Scenario=Random Drop-out CS2026.02 | 9.01 | 68.59 | |
| CBM (HI)Concept Shift Scenario=Random Drop-out CS2026.02 | 8.78 | 69.06 | |
| CBM (HI) + IBBConcept Shift Scenario=Selective Drop-out CS2026.02 | 8.31 | 67.18 | |
| CBM (HI) + IBBConcept Shift Scenario=Random Drop-out CS2026.02 | 8.25 | 67.3 | |
| IntCEMConcept Shift Scenario=Complete CS2026.02 | 6.36 | 72.48 | |
| IntCEM + IBBConcept Shift Scenario=Complete CS2026.02 | 5.78 | 68.66 | |
| ProbCBMConcept Shift Scenario=Complete CS2026.02 | 4.35 | 64.19 | |
| AR-CBMConcept Shift Scenario=Complete CS2026.02 | 3.89 | 62.25 | |
| CBM (SJ)Concept Shift Scenario=Complete CS2026.02 | 2.97 | 64.39 | |
| AR-CBM + IBBConcept Shift Scenario=Complete CS2026.02 | 2.72 | 60 | |
| CBM (HJ)Concept Shift Scenario=Complete CS2026.02 | 2.66 | 57.97 | |
| CBM (SJ) + IBBConcept Shift Scenario=Complete CS2026.02 | 2.6 | 61.55 | |
| ProbCBM + IBBConcept Shift Scenario=Complete CS2026.02 | 2.59 | 59.86 | |
| CBM (HJ) + IBBConcept Shift Scenario=Complete CS2026.02 | 2.35 | 56.91 | |
| CBM (HI)Concept Shift Scenario=Complete CS2026.02 | 1.94 | 62.97 | |
| CBM (HI) + IBBConcept Shift Scenario=Complete CS2026.02 | 1.8 | 60.03 |