# ScienceExamCER: A High-Density Fine-Grained Science-Domain Corpus for Common Entity Recognition

Source: [ScienceExamCER: A High-Density Fine-Grained Science-Domain Corpus for Common Entity Recognition](<https://www.sota2.com/research/paper/68fa66b61e209131cea12040>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:57:21.263Z

Authors: Hannah Smith, Zeyu Zhang, John Culnan, Peter Jansen

Published: 2019-11-24T00:08:09.000Z

## Abstract

Named entity recognition identifies common classes of entities in text, but these entity labels are generally sparse, limiting utility to downstream tasks. In this work we present ScienceExamCER, a densely-labeled semantic classification corpus of 133k mentions in the science exam domain where nearly all (96%) of content words have been annotated with one or more fine-grained semantic class labels including taxonomic groups, meronym groups, verb/action groups, properties and values, and synonyms. Semantic class labels are drawn from a manually-constructed fine-grained typology of 601 classes generated through a data-driven analysis of 4,239 science exam questions. We show an off-the-shelf BERT-based named entity recognition model modified for multi-label classification achieves an accuracy of 0.85 F1 on this task, suggesting strong utility for downstream tasks in science domain question answering requiring densely-labeled semantic classification.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1911.10436>)

[PDF](<https://arxiv.org/pdf/1911.10436.pdf>)
