Safety Defense Evaluation on Math
0ASRPatcher
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PatcherAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 0 | 32 | |
| PatcherAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 0 | 31 | |
| PatcherAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 0 | 25 | |
| PatcherAttack=UJB, Backbone Model=MAmmoTH22026.06 | 1 | 34 | |
| PatcherAttack=CBA, Backbone Model=MAmmoTH22026.06 | 1 | 31 | |
| MudjackingAttack=CBA, Backbone Model=MAmmoTH22026.06 | 29 | 27 | |
| SPPAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 73 | 29 | |
| SPPAttack=UJB, Backbone Model=MAmmoTH22026.06 | 82 | 31 | |
| BAERASERAttack=UJB, Backbone Model=MAmmoTH22026.06 | 83 | 32 | |
| BAERASERAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 83 | 27 | |
| OneShotAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 85 | 28 | |
| FTAttack=CBA, Backbone Model=MAmmoTH22026.06 | 85 | 26 | |
| FTℓ∞Attack=CBA, Backbone Model=MAmmoTH22026.06 | 85 | 27 | |
| MENDAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 86 | 28 | |
| FTℓ2Attack=CBA, Backbone Model=MAmmoTH22026.06 | 86 | 27 | |
| FTℓ∞Attack=BadNets, Backbone Model=MAmmoTH22026.06 | 87 | 28 | |
| MudjackingAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 87 | 30 | |
| FinePruningAttack=CBA, Backbone Model=MAmmoTH22026.06 | 87 | 30 | |
| BAERASERAttack=CBA, Backbone Model=MAmmoTH22026.06 | 87 | 30 | |
| UnpatchedAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 88 | 32 | |
| FTAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 88 | 28 | |
| FTℓ2Attack=BadNets, Backbone Model=MAmmoTH22026.06 | 88 | 29 | |
| FinePruningAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 88 | 31 | |
| ROMEAttack=BadNets, Backbone Model=MAmmoTH22026.06 | 88 | 29 | |
| ROMEAttack=CBA, Backbone Model=MAmmoTH22026.06 | 88 | 29 | |
| FTAttack=UJB, Backbone Model=MAmmoTH22026.06 | 89 | 25 | |
| OneShotAttack=UJB, Backbone Model=MAmmoTH22026.06 | 89 | 33 | |
| SPPAttack=CBA, Backbone Model=MAmmoTH22026.06 | 89 | 30 | |
| OneShotAttack=CBA, Backbone Model=MAmmoTH22026.06 | 89 | 30 | |
| MENDAttack=CBA, Backbone Model=MAmmoTH22026.06 | 89 | 29 | |
| FinePruningAttack=UJB, Backbone Model=MAmmoTH22026.06 | 90 | 33 | |
| UnpatchedAttack=CBA, Backbone Model=MAmmoTH22026.06 | 90 | 32 | |
| MudjackingAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 90 | 22 | |
| SPPAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 90 | 26 | |
| OneShotAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 90 | 25 | |
| MudjackingAttack=UJB, Backbone Model=MAmmoTH22026.06 | 92 | 30 | |
| FTℓ∞Attack=POLISHED, Backbone Model=MAmmoTH22026.06 | 92 | 16 | |
| UnpatchedAttack=UJB, Backbone Model=MAmmoTH22026.06 | 93 | 35 | |
| FTℓ2Attack=UJB, Backbone Model=MAmmoTH22026.06 | 93 | 34 | |
| FTℓ∞Attack=UJB, Backbone Model=MAmmoTH22026.06 | 93 | 27 | |
| MENDAttack=UJB, Backbone Model=MAmmoTH22026.06 | 93 | 35 | |
| ROMEAttack=UJB, Backbone Model=MAmmoTH22026.06 | 93 | 35 | |
| FTAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 94 | 21 | |
| FTAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 95 | 24 | |
| BAERASERAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 95 | 29 | |
| OneShotAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 95 | 30 | |
| UnpatchedAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 32 | |
| FTℓ2Attack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 32 | |
| FinePruningAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 30 | |
| MudjackingAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 30 | |
| SPPAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 32 | |
| MENDAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 32 | |
| ROMEAttack=POLISHED, Backbone Model=MAmmoTH22026.06 | 96 | 32 | |
| FinePruningAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 97 | 25 | |
| UnpatchedAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 98 | 26 | |
| FTℓ2Attack=Sleeper, Backbone Model=MAmmoTH22026.06 | 98 | 22 | |
| FTℓ∞Attack=Sleeper, Backbone Model=MAmmoTH22026.06 | 98 | 9 | |
| BAERASERAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 98 | 22 | |
| MENDAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 98 | 26 | |
| ROMEAttack=Sleeper, Backbone Model=MAmmoTH22026.06 | 98 | 26 |