# The 2025 PNPL Competition: Speech Detection and Phoneme Classification in the LibriBrain Dataset

Source: [The 2025 PNPL Competition: Speech Detection and Phoneme Classification in the LibriBrain Dataset](<https://www.sota2.com/research/paper/68fa79531e209131cea7d173>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T04:55:51.332Z

Authors: Gilad Landau, Miran \\"Ozdogan, Gereon Elvers, Francesco Mantegna, Pratik Somaiya, Dulhan Jayalath, Luisa Kurth, Teyun Kwon, Brendan Shillingford, Greg Farquhar, Minqi Jiang, Karim Jerbi, Hamza Abdelhedi, Yorguin Mantilla Ramos, Caglar Gulcehre, Mark Woolrich, Natalie Voets, Oiwi Parker Jones

Published: 2025-06-11T20:34:33.000Z

## Abstract

The advance of speech decoding from non-invasive brain data holds the potential for profound societal impact. Among its most promising applications is the restoration of communication to paralysed individuals affected by speech deficits such as dysarthria, without the need for high-risk surgical interventions. The ultimate aim of the 2025 PNPL competition is to produce the conditions for an "ImageNet moment" or breakthrough in non-invasive neural decoding, by harnessing the collective power of the machine learning community.   To facilitate this vision we present the largest within-subject MEG dataset recorded to date (LibriBrain) together with a user-friendly Python library (pnpl) for easy data access and integration with deep learning frameworks. For the competition we define two foundational tasks (i.e. Speech Detection and Phoneme Classification from brain data), complete with standardised data splits and evaluation metrics, illustrative benchmark models, online tutorial code, a community discussion board, and public leaderboard for submissions. To promote accessibility and participation the competition features a Standard track that emphasises algorithmic innovation, as well as an Extended track that is expected to reward larger-scale computing, accelerating progress toward a non-invasive brain-computer interface for speech.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Speech Detection on LibriBrain (holdout)](<https://www.sota2.com/research/sota/speech-detection-on-libribrain-holdout.md>): Speech Detection; LibriBrain (holdout); F1-macro: 68.04.

- [Phoneme Classification on LibriBrain (holdout)](<https://www.sota2.com/research/sota/phoneme-classification-on-libribrain-holdout.md>): Phoneme Classification; LibriBrain (holdout); F1 Macro: 6.1.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2506.10165>)

[PDF](<https://arxiv.org/pdf/2506.10165.pdf>)
