Model Stealing Defense on MedQA
62.3AgreementNo Defense
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseQuery budget (B)=500, Number of seeds=52026.06 | 62.3 | 44 | 0 | |
| PRADAQuery budget (B)=500, Number of seeds=52026.06 | 61.8 | 43.6 | 0.4 | |
| DRWQuery budget (B)=500, Number of seeds=52026.06 | 60.4 | 43.1 | 4.8 | |
| HoneypotNetQuery budget (B)=500, Number of seeds=52026.06 | 59.7 | 42.4 | 1.5 | |
| KT w/o BreadcrumbQuery budget (B)=500, Number of seeds=52026.06 | 59.1 | 41.4 | 0 | |
| KT w/o DetectionQuery budget (B)=500, Number of seeds=52026.06 | 58.4 | 40.3 | 0 | |
| Output Pert.Query budget (B)=500, Number of seeds=52026.06 | 58.1 | 42.6 | 2.1 | |
| KT (Full)†Query budget (B)=500, Number of seeds=52026.06 | 54.1 | 37.8 | 0 |