Named Entity Recognition on Yale New Haven Health (YNHH) clinical notes Three-site experiment (test)
73.3Strict F1LLaMA3-8B (Centralized)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaMA3-8B (Centralized)Model=LLaMA3-8B, Strategy=Centralized (Upper bound)2026.01 | 73.3 | 75.5 | 71.1 | 85.8 | 85.8 | 85.9 | |
| Fed-MedLoRA+Model=LLaMA3-8B, Strategy=Federated Learning2026.01 | 73 | 73.2 | 72.9 | 85.4 | 85.2 | 85.6 | |
| Fed-MedLoRAModel=LLaMA3-8B, Strategy=Federated Learning2026.01 | 72.2 | 71.8 | 72.6 | 84.8 | 84.3 | 85.3 | |
| Bio_ClinicalBERT (Centralized)Model=Bio_ClinicalBERT, Strategy=Centralized (Upper bound)2026.01 | 60.6 | 63.1 | 58.3 | 64.6 | 66.9 | 62.4 | |
| LLaMA3-8B (Zero-shot)Model=LLaMA3-8B, Strategy=Zero-shot (Baseline)2026.01 | 39.7 | 34.8 | 46.2 | 52.4 | 45.9 | 60.9 |