Privacy Leakage and Utility Assessment on HealthCareMagic
750Context Retrieval ScoreExtraction
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ExtractionModel=Pythia-6.9B2025.08 | 750 | 264 | 167 | 137 | 166 | 10.94 | |
| Summ.Model=Pythia-6.9B2025.08 | 750 | 150 | 120 | 90 | 105 | 12.1 | |
| Dist.Model=Pythia-6.9B2025.08 | 750 | 140 | 115 | 80 | 100 | 11.45 | |
| StaticModel=Pythia-6.9B2025.08 | 750 | 135 | 112 | 75 | 99 | 10.45 | |
| PADModel=Pythia-6.9B2025.08 | 750 | 127 | 107 | 69 | 92 | 9.88 | |
| ExtractionModel=Llama2-7B2025.08 | 750 | 235 | 167 | 141 | 166 | 10.74 | |
| Summ.Model=Llama2-7B2025.08 | 750 | 188 | 140 | 82 | 109 | 12.12 | |
| Dist.Model=Llama2-7B2025.08 | 750 | 178 | 130 | 78 | 105 | 11.01 | |
| StaticModel=Llama2-7B2025.08 | 750 | 172 | 125 | 76 | 100 | 10.02 | |
| PADModel=Llama2-7B2025.08 | 750 | 168 | 120 | 70 | 94 | 9.43 |