# Clinical Concept Extraction on i2b2 2010 (test) Source: [Clinical Concept Extraction on i2b2 2010 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-10T10:23:32.852Z Evaluation of Clinical Concept Extraction performance on the test split of the i2b2 2010 dataset, measured using Exact F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Clinical concept extraction | | Dataset (including any stated split) | i2b2 2010 (test) | | Metric | Exact F1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact F1 | Result date | Report paper | | --- | --- | --- | --- | | BERTlarge | 90.25 | Not recorded | 68fa663c1e209131cea0f0eb | | BERTbase | 89.55 | Not recorded | 68fa663c1e209131cea0f0eb | | Baseline\_BlueBERT | 89.2 | Not recorded | 69afa5a72d603e6de3e43d1b | | Prior SOTA (Zhu et al., 2018) | 88.6 | Not recorded | 68fa663c1e209131cea0f0eb | | ELMo | 87.8 | Not recorded | 68fa663c1e209131cea0f0eb | | Alsentzer 2019b | 87.8 | Not recorded | 69afa5a72d603e6de3e43d1b | | Lee 2020 | 86.7 | Not recorded | 69afa5a72d603e6de3e43d1b | | BERTlarge | 85.48 | Not recorded | 68fa663c1e209131cea0f0eb | | i2b2/VA Best | 85.2 | Not recorded | 69afa5a72d603e6de3e43d1b | | GloVe | 85.07 | Not recorded | 68fa663c1e209131cea0f0eb | | BioBERT | 84.76 | Not recorded | 68fa663c1e209131cea0f0eb | | BERTbase | 84.33 | Not recorded | 68fa663c1e209131cea0f0eb | | word2vec | 84.32 | Not recorded | 68fa663c1e209131cea0f0eb | | fastText | 84.19 | Not recorded | 68fa663c1e209131cea0f0eb | | GloVe | 84.08 | Not recorded | 68fa663c1e209131cea0f0eb | | ELMo | 83.83 | Not recorded | 68fa663c1e209131cea0f0eb | | fastText | 83.46 | Not recorded | 68fa663c1e209131cea0f0eb | | word2vec | 80.38 | Not recorded | 68fa663c1e209131cea0f0eb | ### BERTlarge Exact F1: 90.25. Result ID: 698ce4bb8b517eb4331d7a11. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"MIMIC"}. This record does not assert independent reproduction. ### BERTbase Exact F1: 89.55. Result ID: 698ce4bb8b517eb4331d7a0f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"MIMIC"}. This record does not assert independent reproduction. ### Baseline\_BlueBERT Exact F1: 89.2. Result ID: 69aff1196dbb7075b958fac8. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"BlueBERT"}. This record does not assert independent reproduction. ### Prior SOTA (Zhu et al., 2018) Exact F1: 88.6. Result ID: 698ce4bb8b517eb4331d7a13. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ELMo Exact F1: 87.8. Result ID: 698ce4bb8b517eb4331d7a0d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"MIMIC"}. This record does not assert independent reproduction. ### Alsentzer 2019b Exact F1: 87.8. Result ID: 69aff1196dbb7075b958fac6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Lee 2020 Exact F1: 86.7. Result ID: 69aff1196dbb7075b958fac7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### BERTlarge Exact F1: 85.48. Result ID: 698ce4bb8b517eb4331d7a10. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. ### i2b2/VA Best Exact F1: 85.2. Result ID: 69aff1196dbb7075b958fac5. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GloVe Exact F1: 85.07. Result ID: 698ce4bb8b517eb4331d7a09. [Reporting paper]() Recorded evaluation configuration: {"Pre-training Corpus":"MIMIC"}. This record does not assert independent reproduction. ### BioBERT Exact F1: 84.76. Result ID: 698ce4bb8b517eb4331d7a12. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. ### BERTbase Exact F1: 84.33. Result ID: 698ce4bb8b517eb4331d7a0e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. ### word2vec Exact F1: 84.32. Result ID: 698ce4bb8b517eb4331d7a07. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"MIMIC"}. This record does not assert independent reproduction. ### fastText Exact F1: 84.19. Result ID: 698ce4bb8b517eb4331d7a0b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Pre-training Corpus":"MIMIC"}. This record does not assert independent reproduction. ### GloVe Exact F1: 84.08. Result ID: 698ce4bb8b517eb4331d7a08. [Reporting paper]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. ### ELMo Exact F1: 83.83. Result ID: 698ce4bb8b517eb4331d7a0c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. ### fastText Exact F1: 83.46. Result ID: 698ce4bb8b517eb4331d7a0a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. ### word2vec Exact F1: 80.38. Result ID: 698ce4bb8b517eb4331d7a06. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Pre-training Corpus":"General"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.