Model Stealing Defense on FinQA
33.7Agreement (%)Output Pert.
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Output Pert.Query budget (B)=500, Number of seeds=52026.06 | 33.7 | 42.6 | 2.1 | |
| PRADAQuery budget (B)=500, Number of seeds=52026.06 | 30.3 | 43.6 | 0.4 | |
| DRWQuery budget (B)=500, Number of seeds=52026.06 | 30.1 | 43.1 | 4.8 | |
| HoneypotNetQuery budget (B)=500, Number of seeds=52026.06 | 29.3 | 42.4 | 1.5 | |
| No DefenseQuery budget (B)=500, Number of seeds=52026.06 | 28.4 | 44 | 0 | |
| KT w/o BreadcrumbQuery budget (B)=500, Number of seeds=52026.06 | 26.3 | 41.4 | 0 | |
| KT (Full)†Query budget (B)=500, Number of seeds=52026.06 | 25.7 | 37.8 | 0 | |
| KT w/o DetectionQuery budget (B)=500, Number of seeds=52026.06 | 25.1 | 40.3 | 0 |