Negation Detection on Clinical Notes
96.1F1 ScoreFully supervised BioBERT (FS)
Evaluation results
| Method | Links | |
|---|---|---|
| Fully supervised BioBERT (FS)Supervision Source=Hand-labeled2020.08 | 96.1 | |
| mistral3.1:24bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 94.4 | |
| gemma3:27bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 93.9 | |
| Label Model (LM)Supervision Source=+ Task-specific Rules, LFs=172020.08 | 93 | |
| Weakly supervised BioBERT (WS)Supervision Source=+ Task-specific Rules, LFs=172020.08 | 92.7 | |
| Majority Vote (MV)Supervision Source=+ Task-specific Rules, LFs=172020.08 | 92.5 | |
| gpt-oss:20bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 91.9 | |
| llama3.1:8bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 91.3 | |
| gemma3:27bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 90.5 | |
| gemma3:27bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 89.4 | |
| mistral3.1:24bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 88.9 | |
| gpt-oss:20bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 87.8 | |
| mistral3.1:24bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 87.7 | |
| gemma3:27bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 86 | |
| gpt-oss:20bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 85.5 | |
| llama3.1:8bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 83.3 | |
| mistral3.1:24bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 82.5 | |
| gpt-oss:20bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 81.7 | |
| llama3.1:8bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 81.3 | |
| llama3.1:8bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 74.8 |