# What Works Better? A Study of Classifying Requirements

Source: [What Works Better? A Study of Classifying Requirements](<https://www.sota2.com/research/paper/68fa63831e209131ce9ff19b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T20:42:16.909Z

Authors: Zahra Shakeri Hossein Abad, Oliver Karras, Parisa Ghazi, Martin Glinz, Guenther Ruhe, Kurt Schneider

Published: 2017-07-07T20:54:22.000Z

## Abstract

Classifying requirements into functional requirements (FR) and non-functional ones (NFR) is an important task in requirements engineering. However, automated classification of requirements written in natural language is not straightforward, due to the variability of natural language and the absence of a controlled vocabulary. This paper investigates how automated classification of requirements into FR and NFR can be improved and how well several machine learning approaches work in this context. We contribute an approach for preprocessing requirements that standardizes and normalizes requirements before applying classification algorithms. Further, we report on how well several existing machine learning methods perform for automated classification of NFRs into sub-categories such as usability, availability, or performance. Our study is performed on 625 requirements provided by the OpenScience tera-PROMISE repository. We found that our preprocessing improved the performance of an existing classification method. We further found significant differences in the performance of approaches such as Latent Dirichlet Allocation, Biterm Topic Modeling, or Naive Bayes for the sub-classification of NFRs.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Multi-class classification on PROMISE original (10-fold cross-validation)](<https://www.sota2.com/research/sota/multi-class-classification-on-promise-original-10-fold-cross-validation.md>): Multi-class classification; PROMISE original (10-fold cross-validation); F1 Score (A): 90.

- [FR/NFR Classification on PROMISE original (10-fold cross val)](<https://www.sota2.com/research/sota/fr-nfr-classification-on-promise-original-10-fold-cross-val.md>): FR/NFR Classification; PROMISE original (10-fold cross val); FR Precision: 90.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1707.02358>)

[PDF](<https://arxiv.org/pdf/1707.02358.pdf>)
