De-identification on MIMIC-III 100 discharge notes 1.4 (test)
99PrecisionBERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BERTEvaluation Protocol=Fine-tuned, Time (s)=67, STD (s)=2, Words/sec=20482026.01 | 99 | 99 | 99 | |
| ModernBERTEvaluation Protocol=Fine-tuned, Time (s)=90, STD (s)=3.1, Words/sec=15282026.01 | 99 | 99 | 99 | |
| ClinicalBERTEvaluation Protocol=Fine-tuned, Time (s)=56, STD (s)=1.8, Words/sec=24462026.01 | 99 | 99 | 99 | |
| Llama-1bEvaluation Protocol=Fine-tuned, Time (s)=108, STD (s)=3, Words/sec=12712026.01 | 97 | 96 | 99 | |
| Llama-3bEvaluation Protocol=Fine-tuned, Time (s)=176, STD (s)=5.4, Words/sec=7762026.01 | 97 | 97 | 99 | |
| Llama-8bEvaluation Protocol=Fine-tuned, Time (s)=322, STD (s)=6.2, Words/sec=4232026.01 | 97 | 97 | 99 | |
| Qwen-1.5BEvaluation Protocol=Fine-tuned, Time (s)=122, STD (s)=2.5, Words/sec=11212026.01 | 96 | 94 | 99 | |
| Qwen-3BEvaluation Protocol=Fine-tuned, Time (s)=182, STD (s)=2.8, Words/sec=7512026.01 | 96 | 95 | 99 | |
| Qwen-7BEvaluation Protocol=Fine-tuned, Time (s)=308, STD (s)=4.4, Words/sec=4432026.01 | 96 | 95 | 99 | |
| obi-deid-bertEvaluation Protocol=Fine-tuned, Time (s)=41, STD (s)=1.4, Words/sec=33332026.01 | 91 | 94 | 99 | |
| Qwen-72BEvaluation Protocol=Prompt-tuned, Time (s)=16315, Words/sec=82026.01 | 80 | 97 | 98 | |
| Llama-70BEvaluation Protocol=Prompt-tuned, Time (s)=12870, Words/sec=102026.01 | 75 | 97 | 98 | |
| pyDeidEvaluation Protocol=Rule-based, Time (s)=31, STD (s)=0.2, Words/sec=44902026.01 | 67 | 68 | 99 | |
| PresidioEvaluation Protocol=NER-based, Time (s)=28, STD (s)=0.1, Words/sec=49312026.01 | 61 | 91 | 89 |