Text Anonymization on PersonalReddit (test)
49.76SROriginal
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Original2024.07 | 49.76 | 81.89 | 55.13 | 63.51 | 55.8 | 58.45 | 1.5695 | |
| Azuresource=Aahill, 20232024.07 | 45.89 | 81.07 | 54.04 | 58.49 | 54.17 | 57 | 1.734 | |
| SD2024.07 | 44.05 | 75.17 | 54.11 | 58.43 | 54.21 | 56.93 | 1.7501 | |
| DEID-GPT2024.07 | 43.12 | 72.81 | 53.98 | 58.21 | 54.06 | 56.31 | 1.9314 | |
| RUPTABackbone=Llama-3-70b2024.07 | 39.61 | 61.63 | 32.96 | 44.57 | 32.82 | 38.65 | 2.3131 | |
| IncogniText2024.07 | 37.55 | 60.02 | 10.19 | 11.06 | 10.61 | 13.47 | 4.4766 | |
| RUPTABackbone=GPT-42024.07 | 35.75 | 55.04 | 30.34 | 39.14 | 30.09 | 35.75 | 2.5391 | |
| AF2024.07 | 35.4 | 57.76 | 16.64 | 22.32 | 16.68 | 21.26 | 3.338 | |
| RUPTABackbone=Mixtral 8x22b2024.07 | 35.27 | 65.56 | 37.37 | 47.82 | 37.67 | 43.48 | 2.2836 | |
| RUPTABackbone=GPT-3.52024.07 | 34.3 | 61.5 | 32.04 | 40.44 | 31.97 | 36.23 | 2.4477 |