ROS Entity Recognition on Clinical Notes
95.2F1 Scoremistral3.1:24b
Evaluation results
| Method | Links | |
|---|---|---|
| mistral3.1:24bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 95.2 | |
| gemma3:27bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 95.1 | |
| llama3.1:8bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 92.8 | |
| gpt-oss:20bAttribution=With attribution, Match Criterion=RELAX MATCH2025.05 | 92.5 | |
| gemma3:27bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 91.2 | |
| gemma3:27bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 90.6 | |
| mistral3.1:24bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 89.4 | |
| mistral3.1:24bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 88.4 | |
| gpt-oss:20bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 88.4 | |
| gemma3:27bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 86.4 | |
| gpt-oss:20bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 86 | |
| llama3.1:8bAttribution=With attribution, Match Criterion=EXACT MATCH2025.05 | 85 | |
| mistral3.1:24bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 82.7 | |
| llama3.1:8bAttribution=Without attribution, Match Criterion=RELAX MATCH2025.05 | 82.1 | |
| gpt-oss:20bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 82 | |
| llama3.1:8bAttribution=Without attribution, Match Criterion=EXACT MATCH2025.05 | 75.5 |