# The Death of Feature Engineering? BERT with Linguistic Features on SQuAD 2.0

Source: [The Death of Feature Engineering? BERT with Linguistic Features on SQuAD 2.0](<https://www.sota2.com/research/paper/68fa72d11e209131cea58b45>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:34:49.549Z

Authors: Jiawei Li, Yue Zhang

Published: 2024-04-04T03:50:34.000Z

## Abstract

Machine reading comprehension is an essential natural language processing task, which takes into a pair of context and query and predicts the corresponding answer to query. In this project, we developed an end-to-end question answering model incorporating BERT and additional linguistic features. We conclude that the BERT base model will be improved by incorporating the features. The EM score and F1 score are improved 2.17 and 2.14 compared with BERT(base). Our best single model reaches EM score 76.55 and F1 score 79.97 in the hidden test set. Our error analysis also shows that the linguistic architecture can help model understand the context better in that it can locate answers that BERT only model predicted "No Answer" wrongly.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2404.03184>)

[PDF](<https://arxiv.org/pdf/2404.03184.pdf>)
