# Exploring Neural Net Augmentation to BERT for Question Answering on SQUAD 2.0 Source: [Exploring Neural Net Augmentation to BERT for Question Answering on SQUAD 2.0]() Collection index: [llms.txt]() Data updated: 2025-10-25T22:09:20.078Z Authors: Suhas Gupta Published: 2019-08-04T16:48:24.000Z ## Abstract Enhancing machine capabilities to answer questions has been a topic of considerable focus in recent years of NLP research. Language models like Embeddings from Language Models (ELMo)\[1\] and Bidirectional Encoder Representations from Transformers (BERT) \[2\] have been very successful in developing general purpose language models that can be optimized for a large number of downstream language tasks. In this work, we focused on augmenting the pre-trained BERT language model with different output neural net architectures and compared their performance on question answering task posed by the Stanford Question Answering Dataset 2.0 (SQUAD 2.0) \[3\]. Additionally, we also fine-tuned the pre-trained BERT model parameters to demonstrate its effectiveness in adapting to specialized language tasks. Our best output network, is the contextualized CNN that performs on both the unanswerable and answerable question answering tasks with F1 scores of 75.32 and 64.85 respectively. ## Recorded benchmark results A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. ## Original sources and implementation [Original paper]() [PDF]()