Model Stealing Defense on MedMCQA
50.2Agreement (%)No Defense
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseQuery budget (B)=500, Number of seeds=52026.06 | 50.2 | 44 | 0 | |
| PRADAQuery budget (B)=500, Number of seeds=52026.06 | 48.4 | 43.6 | 0.4 | |
| DRWQuery budget (B)=500, Number of seeds=52026.06 | 48.1 | 43.1 | 4.8 | |
| HoneypotNetQuery budget (B)=500, Number of seeds=52026.06 | 47.8 | 42.4 | 1.5 | |
| KT w/o BreadcrumbQuery budget (B)=500, Number of seeds=52026.06 | 47.4 | 41.4 | 0 | |
| Output Pert.Query budget (B)=500, Number of seeds=52026.06 | 47.3 | 42.6 | 2.1 | |
| KT w/o DetectionQuery budget (B)=500, Number of seeds=52026.06 | 46.3 | 40.3 | 0 | |
| KT (Full)†Query budget (B)=500, Number of seeds=52026.06 | 42.8 | 37.8 | 0 |