# Large Language Models for Multi-Choice Question Classification of Medical Subjects

Source: [Large Language Models for Multi-Choice Question Classification of Medical Subjects](<https://www.sota2.com/research/paper/68fa729e1e209131cea5793a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:30:51.475Z

Authors: V\\'ictor Ponce-L\\'opez

Published: 2024-03-21T17:36:08.000Z

## Abstract

The aim of this paper is to evaluate whether large language models trained on multi-choice question data can be used to discriminate between medical subjects. This is an important and challenging task for automatic question answering. To achieve this goal, we train deep neural networks for multi-class classification of questions into the inferred medical subjects. Using our Multi-Question (MQ) Sequence-BERT method, we outperform the state-of-the-art results on the MedMCQA dataset with an accuracy of 0.68 and 0.60 on their development and test sets, respectively. In this sense, we show the capability of AI and LLMs in particular for multi-classification tasks in the Healthcare domain.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2403.14582>)

[PDF](<https://arxiv.org/pdf/2403.14582.pdf>)
