# Efficient Software Vulnerability Detection Using Transformer-based Models

Source: [Efficient Software Vulnerability Detection Using Transformer-based Models](<https://www.sota2.com/research/paper/69cdf7eb0636e5bf4afcc943>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-03T05:00:04.568Z

Authors: Sameer Shaik, Zhen Huang, Daniela Stan Raicu, Jacob Furst

Published: 2026-03-31T18:23:04.000Z

## Abstract

Detecting software vulnerabilities is critical to ensuring the security and reliability of modern computer systems. Deep neural networks have shown promising results on vulnerability detection, but they lack the capability to capture global contextual information on vulnerable code. To address this limitation, we explore the application of transformers for C/C++ vulnerability detection. We use program slices that encapsulate key syntactic and semantic features of program code, such as API function calls, array usage, pointer manipulations, and arithmetic expressions. By leveraging transformers' capability to capture both local and global contextual information on vulnerable code, our work can identify vulnerabilities accurately. Combined with data balancing and hyperparameter fine-tuning, our work offers a robust and efficient approach to identifying vulnerable code with moderate resource usage and training time.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Vulnerability Detection on SeVC](<https://www.sota2.com/research/sota/vulnerability-detection-on-sevc.md>): Vulnerability Detection; SeVC; Accuracy: not recorded.

- [Vulnerability Detection on SARD 15](<https://www.sota2.com/research/sota/vulnerability-detection-on-sard-15.md>): Vulnerability Detection; SARD 15; Accuracy: not recorded.

- [Vulnerability Detection on SARD 10](<https://www.sota2.com/research/sota/vulnerability-detection-on-sard-10.md>): Vulnerability Detection; SARD 10; Accuracy: not recorded.

- [Vulnerability Detection on SARD 22](<https://www.sota2.com/research/sota/vulnerability-detection-on-sard-22.md>): Vulnerability Detection; SARD 22; Accuracy: not recorded.

- [Vulnerability Detection on SARD 1](<https://www.sota2.com/research/sota/vulnerability-detection-on-sard-1.md>): Vulnerability Detection; SARD 1; Accuracy: not recorded.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2604.00112>)

[PDF](<https://arxiv.org/pdf/2604.00112.pdf>)
