Model Stealing Defense on ConvFinQA
37.8Agreement (%)No Defense
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| No DefenseQuery budget (B)=500, Number of seeds=52026.06 | 37.8 | 44 | 0 | |
| DRWQuery budget (B)=500, Number of seeds=52026.06 | 36.3 | 43.1 | 4.8 | |
| PRADAQuery budget (B)=500, Number of seeds=52026.06 | 36.1 | 43.6 | 0.4 | |
| HoneypotNetQuery budget (B)=500, Number of seeds=52026.06 | 35.6 | 42.4 | 1.5 | |
| KT w/o BreadcrumbQuery budget (B)=500, Number of seeds=52026.06 | 35.4 | 41.4 | 0 | |
| KT w/o DetectionQuery budget (B)=500, Number of seeds=52026.06 | 34.3 | 40.3 | 0 | |
| Output Pert.Query budget (B)=500, Number of seeds=52026.06 | 34.2 | 42.6 | 2.1 | |
| KT (Full)†Query budget (B)=500, Number of seeds=52026.06 | 31.2 | 37.8 | 0 |