Text Anonymization on DB-bio (test)
1Success RateOriginal
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| OriginalDescription=Non-anonymized reference2024.07 | 1 | — | — | 0.9845 | 0.9958 | 0.9968 | 0.9961 | 0.9958 | 0.0422 | |
| Azure2024.07 | 0.7824 | — | — | 0.8087 | 0.9163 | 0.9504 | 0.9239 | 0.9247 | 0.3202 | |
| DEID-GPTBackbone=GPT-42024.07 | 0.771 | — | — | 0.7947 | 0.9082 | 0.9437 | 0.9256 | 0.9122 | 0.3103 | |
| SDBackbone=GPT-42024.07 | 0.7321 | — | — | 0.7363 | 0.9227 | 0.9311 | 0.9269 | 0.9296 | 0.2719 | |
| RUPTABackbone=GPT-3.52024.07 | 0.6851 | — | — | 0.6916 | 0.954 | 0.9602 | 0.957 | 0.9549 | 0.2188 | |
| RUPTABackbone=Mixtral 8x22b2024.07 | 0.6778 | — | — | 0.6715 | 0.9618 | 0.9713 | 0.963 | 0.9623 | 0.2167 | |
| RUPTABackbone=Llama-3-70b2024.07 | 0.6402 | — | — | 0.6323 | 0.9534 | 0.9623 | 0.9555 | 0.9582 | 0.2224 | |
| IncogniTextBackbone=GPT-42024.07 | 0.5806 | — | — | 0.5628 | 0.8568 | 0.8903 | 0.8732 | 0.8828 | 0.4842 | |
| AFBackbone=GPT-42024.07 | 0.5291 | — | — | 0.5084 | 0.912 | 0.9426 | 0.9175 | 0.9202 | 0.4048 | |
| RUPTABackbone=GPT-42024.07 | 0.5267 | — | — | 0.5311 | 0.9558 | 0.9626 | 0.9591 | 0.9602 | 0.1618 | |
| AFAnonymization Type=rewriting-based2024.07 | — | 3.78 | 3.71 | — | — | — | — | — | — | |
| AzureAnonymization Type=entity-level replacement2024.07 | — | 3.23 | 2.09 | — | — | — | — | — | — | |
| RUPTAAnonymization Type=rewriting-based2024.07 | — | 3.96 | 3.68 | — | — | — | — | — | — | |
| SDAnonymization Type=entity-level replacement2024.07 | — | 3.64 | 3.62 | — | — | — | — | — | — |