Audio-visual event recognition on MIT-MUSIC (test)
91.35AV AccuracyMinSim
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MinSimDefense=Dissimilarity constraint (proposed)2021.04 | 91.35 | 70.19 | 46.15 | 36.54 | 50.96 | 16.35 | |
| MinSim+ExFMemDefense=Full defense model (proposed)2021.04 | 90.38 | 73.08 | 53.85 | 42.31 | 56.41 | 20.83 | |
| MinSim + ExFMem (Full)Attacker=MIM, Attack Strength=0.062021.04 | 90.38 | 64.42 | 27.88 | 18.27 | 36.86 | 26.6 | |
| MaxSimDefense=Maximizing audio-visual similarity2021.04 | 89.42 | 52.88 | 45.19 | 31.73 | 43.27 | 6.73 | |
| ExFMemDefense=External feature memory banks (proposed)2021.04 | 89.42 | 53.85 | 50 | 20.19 | 41.34 | 4.8 | |
| MaxSimAttacker=MIM, Attack Strength=0.062021.04 | 89.42 | 25 | 31.73 | 15.38 | 24.04 | 12.84 | |
| NoneDefense=No defense baseline2021.04 | 88.46 | 51.92 | 45.19 | 15.38 | 37.5 | 0 | |
| NoneAttacker=MIM, Attack Strength=0.062021.04 | 88.46 | 20.19 | 16.35 | 0 | 12.18 | 0 | |
| PCLDefense=Prototype conformity loss2021.04 | 83.65 | 81.73 | 37.5 | 36.54 | 51.91 | 9.6 | |
| PCLAttacker=MIM, Attack Strength=0.062021.04 | 83.65 | 79.81 | 17.31 | 17.31 | 38.14 | 21.15 | |
| Unimodal VDefense=Visual-only network2021.04 | 81.73 | 81.73 | 11.54 | 11.54 | 34.94 | -9.29 | |
| Unimodal VAttacker=MIM, Attack Strength=0.062021.04 | 81.73 | 81.73 | 11.54 | 11.54 | 34.94 | 16.03 | |
| Unimodal ADefense=Audio-only network2021.04 | 59.62 | 0 | 59.62 | 0 | 19.87 | -46.47 | |
| Unimodal AAttacker=MIM, Attack Strength=0.062021.04 | 59.62 | 0 | 59.62 | 0 | 19.87 | -21.15 |