Model Stealing Defense on CaseHOLD
41.5Agreement (%)No Defense
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseQuery budget (B)=500, Number of seeds=52026.06 | 41.5 | 44 | 0 | |
| PRADAQuery budget (B)=500, Number of seeds=52026.06 | 41.2 | 43.6 | 0.4 | |
| DRWQuery budget (B)=500, Number of seeds=52026.06 | 40.7 | 43.1 | 4.8 | |
| Output Pert.Query budget (B)=500, Number of seeds=52026.06 | 39.8 | 42.6 | 2.1 | |
| HoneypotNetQuery budget (B)=500, Number of seeds=52026.06 | 39.4 | 42.4 | 1.5 | |
| KT w/o BreadcrumbQuery budget (B)=500, Number of seeds=52026.06 | 38.6 | 41.4 | 0 | |
| KT w/o DetectionQuery budget (B)=500, Number of seeds=52026.06 | 37.2 | 40.3 | 0 | |
| KT (Full)†Query budget (B)=500, Number of seeds=52026.06 | 35.3 | 37.8 | 0 |