Named Entity Recognition on Yale New Haven Health (YNHH) clinical notes Two-site experiment (test)
0.732Strict F1 ScoreLLaMA3-8B (Centralized)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaMA3-8B (Centralized)Model=LLaMA3-8B, Strategy=Centralized (Upper bound)2026.01 | 0.732 | 0.778 | 0.69 | 0.823 | 0.881 | 0.772 | |
| Fed-MedLoRA+Model=LLaMA3-8B, Strategy=Federated Learning2026.01 | 0.72 | 0.764 | 0.681 | 0.809 | 0.867 | 0.758 | |
| Fed-MedLoRAModel=LLaMA3-8B, Strategy=Federated Learning2026.01 | 0.708 | 0.759 | 0.664 | 0.794 | 0.85 | 0.745 | |
| Bio_ClinicalBERT (Centralized)Model=Bio_ClinicalBERT, Strategy=Centralized (Upper bound)2026.01 | 0.596 | 0.624 | 0.571 | 0.645 | 0.676 | 0.617 | |
| LLaMA3-8B (Zero-shot)Model=LLaMA3-8B, Strategy=Zero-shot (Baseline)2026.01 | 0.397 | 0.348 | 0.462 | 0.524 | 0.459 | 0.609 |