Robustness Certification on Attention blocks
74.2Certification Ratealpha-CROWN
Evaluation results
| Method | Links | ||
|---|---|---|---|
| alpha-CROWNK=4, d=16, epsilon (ϵ)=0.03, Sec./trial=1.6622026.05 | 74.2 | 0.2912 | |
| Vertex-CROWNK=4, d=16, epsilon (ϵ)=0.03, Sec./trial=0.0422026.05 | 74.2 | 0.2809 | |
| Vertex-CROWNK=4, d=16, epsilon (ϵ)=0.05, Sec./trial=0.0332026.05 | 62.5 | 0.1327 | |
| Vertex-CROWNK=6, d=16, epsilon (ϵ)=0.03, Sec./trial=0.0422026.05 | 59.1 | 0.1255 | |
| alpha-CROWNK=6, d=16, epsilon (ϵ)=0.03, Sec./trial=1.6782026.05 | 58.3 | 0.1219 | |
| alpha-CROWNK=4, d=16, epsilon (ϵ)=0.05, Sec./trial=1.5372026.05 | 50 | -0.0311 | |
| ABCrown-BaBK=4, d=16, epsilon (ϵ)=0.05, Sec./trial=267.8062026.05 | 50 | — | |
| Vertex-CROWNK=4, d=32, epsilon (ϵ)=0.03, Sec./trial=0.0372026.05 | 50 | 0.0645 | |
| ABCrown-BaBK=4, d=32, epsilon (ϵ)=0.03, Sec./trial=395.0912026.05 | 29.2 | — | |
| alpha-CROWNK=4, d=32, epsilon (ϵ)=0.03, Sec./trial=1.7522026.05 | 25 | -0.1853 | |
| CROWNK=4, d=16, epsilon (ϵ)=0.05, Sec./trial=0.1582026.05 | 12.5 | -1.035 | |
| CROWNK=4, d=32, epsilon (ϵ)=0.03, Sec./trial=0.1902026.05 | 8.3 | -1.273 |