# Comparative Study of Machine Learning Models and BERT on SQuAD

Source: [Comparative Study of Machine Learning Models and BERT on SQuAD](<https://www.sota2.com/research/paper/68fa67981e209131cea17502>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:02:46.151Z

Authors: Devshree Patel, Param Raval, Ratnam Parikh, Yesha Shastri

Published: 2020-05-22T17:58:30.000Z

## Abstract

This study aims to provide a comparative analysis of performance of certain models popular in machine learning and the BERT model on the Stanford Question Answering Dataset (SQuAD). The analysis shows that the BERT model, which was once state-of-the-art on SQuAD, gives higher accuracy in comparison to other models. However, BERT requires a greater execution time even when only 100 samples are used. This shows that with increasing accuracy more amount of time is invested in training the data. Whereas in case of preliminary machine learning models, execution time for full data is lower but accuracy is compromised.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2005.11313>)

[PDF](<https://arxiv.org/pdf/2005.11313.pdf>)
