Differential Privacy Auditing on Xsum
0Empirical Privacy Loss (epsilon)Passive Auditing
Evaluation Results
| Method | Links | |
|---|---|---|
| Passive Auditingepsilon_theory=4, Mechanism=KSA, Threat Model=Black-box2025.11 | 0 | |
| Active Auditing (SnapAudit)epsilon_theory=4, Mechanism=KSA, Threat Model=Black-box2025.11 | 0 | |
| Passive Auditingepsilon_theory=8, Mechanism=KSA, Threat Model=Black-box2025.11 | 0 | |
| Active Auditing (SnapAudit)epsilon_theory=8, Mechanism=KSA, Threat Model=Black-box2025.11 | 0 | |
| Passive Auditingepsilon_theory=16, Mechanism=KSA, Threat Model=Black-box2025.11 | 0 | |
| Active Auditing (SnapAudit)epsilon_theory=16, Mechanism=KSA, Threat Model=Black-box2025.11 | 0 | |
| Passive Auditingepsilon_theory=2, Mechanism=KSA, Threat Model=Black-box2025.11 | 0.05 | |
| Passive Auditingepsilon_theory=1, Mechanism=ESA, Threat Model=Black-box2025.11 | 0.13 | |
| Passive Auditingepsilon_theory=1, Mechanism=ESA, Threat Model=White-box2025.11 | 0.24 | |
| Active Auditing (SnapAudit)epsilon_theory=1, Mechanism=ESA, Threat Model=Black-box2025.11 | 0.61 | |
| Active Auditing (SnapAudit)epsilon_theory=1, Mechanism=ESA, Threat Model=White-box2025.11 | 0.66 | |
| Passive Auditingepsilon_theory=1, Mechanism=KSA, Threat Model=Black-box2025.11 | 0.83 | |
| Active Auditing (SnapAudit)epsilon_theory=1, Mechanism=KSA, Threat Model=Black-box2025.11 | 0.9 | |
| Passive Auditingepsilon_theory=1, Mechanism=KSA, Threat Model=White-box2025.11 | 0.9 | |
| Active Auditing (SnapAudit)epsilon_theory=1, Mechanism=KSA, Threat Model=White-box2025.11 | 0.94 | |
| Passive Auditingepsilon_theory=2, Mechanism=ESA, Threat Model=Black-box2025.11 | 1.02 | |
| Passive Auditingepsilon_theory=2, Mechanism=ESA, Threat Model=White-box2025.11 | 1.06 | |
| Active Auditing (SnapAudit)epsilon_theory=2, Mechanism=ESA, Threat Model=Black-box2025.11 | 1.23 | |
| Active Auditing (SnapAudit)epsilon_theory=2, Mechanism=ESA, Threat Model=White-box2025.11 | 1.25 | |
| Passive Auditingepsilon_theory=2, Mechanism=KSA, Threat Model=White-box2025.11 | 1.67 | |
| Active Auditing (SnapAudit)epsilon_theory=2, Mechanism=KSA, Threat Model=Black-box2025.11 | 1.75 | |
| Active Auditing (SnapAudit)epsilon_theory=2, Mechanism=KSA, Threat Model=White-box2025.11 | 1.9 | |
| Passive Auditingepsilon_theory=4, Mechanism=ESA, Threat Model=Black-box2025.11 | 2.23 | |
| Passive Auditingepsilon_theory=4, Mechanism=ESA, Threat Model=White-box2025.11 | 2.32 | |
| Active Auditing (SnapAudit)epsilon_theory=4, Mechanism=ESA, Threat Model=Black-box2025.11 | 2.46 | |
| Active Auditing (SnapAudit)epsilon_theory=4, Mechanism=ESA, Threat Model=White-box2025.11 | 2.49 | |
| Passive Auditingepsilon_theory=4, Mechanism=KSA, Threat Model=White-box2025.11 | 3.73 | |
| Active Auditing (SnapAudit)epsilon_theory=4, Mechanism=KSA, Threat Model=White-box2025.11 | 3.89 | |
| Passive Auditingepsilon_theory=8, Mechanism=ESA, Threat Model=Black-box2025.11 | 4.15 | |
| Passive Auditingepsilon_theory=8, Mechanism=ESA, Threat Model=White-box2025.11 | 4.39 | |
| Active Auditing (SnapAudit)epsilon_theory=8, Mechanism=ESA, Threat Model=Black-box2025.11 | 4.84 | |
| Active Auditing (SnapAudit)epsilon_theory=8, Mechanism=ESA, Threat Model=White-box2025.11 | 4.9 | |
| Passive Auditingepsilon_theory=8, Mechanism=KSA, Threat Model=White-box2025.11 | 6.14 | |
| Passive Auditingepsilon_theory=16, Mechanism=KSA, Threat Model=White-box2025.11 | 6.29 | |
| Active Auditing (SnapAudit)epsilon_theory=8, Mechanism=KSA, Threat Model=White-box2025.11 | 7.54 | |
| Passive Auditingepsilon_theory=16, Mechanism=ESA, Threat Model=Black-box2025.11 | 8.92 | |
| Passive Auditingepsilon_theory=16, Mechanism=ESA, Threat Model=White-box2025.11 | 9.06 | |
| Active Auditing (SnapAudit)epsilon_theory=16, Mechanism=ESA, Threat Model=Black-box2025.11 | 9.41 | |
| Active Auditing (SnapAudit)epsilon_theory=16, Mechanism=ESA, Threat Model=White-box2025.11 | 9.62 | |
| Active Auditing (SnapAudit)epsilon_theory=16, Mechanism=KSA, Threat Model=White-box2025.11 | 11.22 |