# Joint Analysis of Sound Events and Acoustic Scenes Using Multitask Learning

Source: [Joint Analysis of Sound Events and Acoustic Scenes Using Multitask Learning](<https://www.sota2.com/research/paper/68fa695c1e209131cea21cbf>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:59:51.007Z

Authors: Noriyuki Tonami, Keisuke Imoto, Ryosuke Yamanishi, Yoichi Yamashita

Published: 2020-10-16T05:51:32.000Z

## Abstract

Sound event detection (SED) and acoustic scene classification (ASC) are important research topics in environmental sound analysis. Many research groups have addressed SED and ASC using neural-network-based methods, such as the convolutional neural network (CNN), recurrent neural network (RNN), and convolutional recurrent neural network (CRNN). The conventional methods address SED and ASC separately even though sound events and acoustic scenes are closely related to each other. For example, in the acoustic scene "office," the sound events "mouse clicking" and "keyboard typing" are likely to occur. Therefore, it is expected that information on sound events and acoustic scenes will be of mutual aid for SED and ASC. In this paper, we propose multitask learning for joint analysis of sound events and acoustic scenes, in which the parts of the networks holding information on sound events and acoustic scenes in common are shared. Experimental results obtained using the TUT Sound Events 2016/2017 and TUT Acoustic Scenes 2016 datasets indicate that the proposed method improves the performance of SED and ASC by 1.31 and 1.80 percentage points in terms of the F-score, respectively, compared with the conventional CRNN-based method.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Acoustic Scene Classification on UAS DCASE Task 1A 2018 (test)](<https://www.sota2.com/research/sota/acoustic-scene-classification-on-uas-dcase-task-1a-2018-test.md>): Acoustic Scene Classification; UAS DCASE Task 1A 2018 (test); Accuracy: 61.69.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2010.09213>)

[PDF](<https://arxiv.org/pdf/2010.09213.pdf>)
