Concept leakage evaluation on AwA2
16.01OISProbCBM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProbCBMConcept Supervision Setting=Selective Drop-out CS2026.02 | 16.01 | 76.92 | |
| IntCEMConcept Supervision Setting=Selective Drop-out CS2026.02 | 14.74 | 74.19 | |
| AR-CBMConcept Supervision Setting=Selective Drop-out CS2026.02 | 14.16 | 63.4 | |
| ProbCBMConcept Supervision Setting=Random Drop-out CS2026.02 | 13.81 | 75.01 | |
| ProbCBM + IB_BConcept Supervision Setting=Selective Drop-out CS2026.02 | 13.07 | 73.06 | |
| AR-CBMConcept Supervision Setting=Random Drop-out CS2026.02 | 12.58 | 60.86 | |
| IntCEMConcept Supervision Setting=Random Drop-out CS2026.02 | 12.16 | 72.24 | |
| CBM (SJ)Concept Supervision Setting=Selective Drop-out CS2026.02 | 11.24 | 70.41 | |
| ProbCBM + IB_BConcept Supervision Setting=Random Drop-out CS2026.02 | 11.2 | 71.2 | |
| AR-CBM + IB_BConcept Supervision Setting=Selective Drop-out CS2026.02 | 11.05 | 60.85 | |
| AR-CBM + IB_BConcept Supervision Setting=Random Drop-out CS2026.02 | 11.03 | 57.21 | |
| IntCEM + IB_BConcept Supervision Setting=Random Drop-out CS2026.02 | 10.93 | 68.94 | |
| CBM (SJ)Concept Supervision Setting=Random Drop-out CS2026.02 | 10.69 | 70.68 | |
| CBM (HJ)Concept Supervision Setting=Selective Drop-out CS2026.02 | 10.09 | 67.58 | |
| IntCEM + IB_BConcept Supervision Setting=Selective Drop-out CS2026.02 | 9.95 | 68.02 | |
| CBM (HJ) + IB_BConcept Supervision Setting=Selective Drop-out CS2026.02 | 9.71 | 64.37 | |
| CBM (SJ) + IB_BConcept Supervision Setting=Selective Drop-out CS2026.02 | 9.52 | 68.12 | |
| CBM (HJ)Concept Supervision Setting=Random Drop-out CS2026.02 | 9.49 | 70.74 | |
| CBM (HJ) + IB_BConcept Supervision Setting=Random Drop-out CS2026.02 | 9.28 | 69.79 | |
| CBM (HI)Concept Supervision Setting=Selective Drop-out CS2026.02 | 9.27 | 64.18 | |
| CBM (SJ) + IB_BConcept Supervision Setting=Random Drop-out CS2026.02 | 8.94 | 68.57 | |
| CBM (HI)Concept Supervision Setting=Random Drop-out CS2026.02 | 8.71 | 69.14 | |
| CBM (HI) + IB_BConcept Supervision Setting=Selective Drop-out CS2026.02 | 8.4 | 67.23 | |
| CBM (HI) + IB_BConcept Supervision Setting=Random Drop-out CS2026.02 | 8.31 | 67.25 | |
| IntCEMConcept Supervision Setting=Complete CS2026.02 | 6.34 | 72.46 | |
| IntCEM + IB_BConcept Supervision Setting=Complete CS2026.02 | 5.79 | 68.57 | |
| ProbCBMConcept Supervision Setting=Complete CS2026.02 | 4.3 | 64.22 | |
| AR-CBMConcept Supervision Setting=Complete CS2026.02 | 3.9 | 62.3 | |
| CBM (SJ)Concept Supervision Setting=Complete CS2026.02 | 3.01 | 64.44 | |
| AR-CBM + IB_BConcept Supervision Setting=Complete CS2026.02 | 2.7 | 60.04 | |
| CBM (SJ) + IB_BConcept Supervision Setting=Complete CS2026.02 | 2.62 | 61.63 | |
| CBM (HJ)Concept Supervision Setting=Complete CS2026.02 | 2.61 | 57.98 | |
| ProbCBM + IB_BConcept Supervision Setting=Complete CS2026.02 | 2.61 | 59.86 | |
| CBM (HJ) + IB_BConcept Supervision Setting=Complete CS2026.02 | 2.29 | 56.89 | |
| CBM (HI)Concept Supervision Setting=Complete CS2026.02 | 2.01 | 63.03 | |
| CBM (HI) + IB_BConcept Supervision Setting=Complete CS2026.02 | 1.78 | 60.05 |