PII Suppression on Enron Email Dataset (test)
102.2Relative ThroughputNCO
Evaluation results
| Method | Links | |
|---|---|---|
| NCOModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=162026.05 | 102.2 | |
| RSModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=12026.05 | 100.7 | |
| NCOModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=12026.05 | 100.5 | |
| RSModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=12026.05 | 100 | |
| NCOModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=12026.05 | 100 | |
| NCOModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=82026.05 | 99.8 | |
| NCOModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=162026.05 | 99.4 | |
| NCOModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=12026.05 | 99.3 | |
| NCOModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=22026.05 | 99.3 | |
| NCOModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=82026.05 | 99.3 | |
| NCOModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=42026.05 | 99.3 | |
| RSModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=12026.05 | 99.2 | |
| NCOModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=42026.05 | 99.1 | |
| NCOModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=42026.05 | 99 | |
| NCOModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=162026.05 | 99 | |
| NCOModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=82026.05 | 98.9 | |
| RSModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=82026.05 | 98.7 | |
| RSModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=22026.05 | 98.6 | |
| NCOModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=22026.05 | 98.5 | |
| RSModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=42026.05 | 98 | |
| NCOModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=22026.05 | 97.9 | |
| RSModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=22026.05 | 97.5 | |
| RSModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=82026.05 | 97.3 | |
| RSModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=22026.05 | 96.9 | |
| RSModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=42026.05 | 96.6 | |
| RSModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=42026.05 | 96.3 | |
| RSModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=162026.05 | 95.7 | |
| RSModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=82026.05 | 95 | |
| RSModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=162026.05 | 94.4 | |
| RSModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=162026.05 | 93 | |
| GUARDModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=12026.05 | 63.6 | |
| GUARDModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=12026.05 | 59.1 | |
| GUARDModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=22026.05 | 48.2 | |
| GUARDModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=22026.05 | 45.8 | |
| GUARDModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=12026.05 | 40.9 | |
| GUARDModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=42026.05 | 31.5 | |
| GUARDModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=42026.05 | 31.1 | |
| GUARDModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=22026.05 | 29.6 | |
| GUARDModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=82026.05 | 25.5 | |
| GUARDModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=82026.05 | 22.1 | |
| GUARDModel=Pythia 6.9B, Unconstrained Violation Rate=82.2%, Batch Size=162026.05 | 20.5 | |
| GUARDModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=42026.05 | 19.4 | |
| GUARDModel=GPT-J 6B, Unconstrained Violation Rate=87.0%, Batch Size=162026.05 | 16.8 | |
| GUARDModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=82026.05 | 13.4 | |
| GUARDModel=GPT-Neo 2.7B, Unconstrained Violation Rate=81.8%, Batch Size=162026.05 | 10 |