Environmental Sound Classification on ESC-50 (5-fold cross-validation)
98.1AccuracyBEATS
Evaluation Results
| Method | Links | |
|---|---|---|
| BEATS2023.10 | 98.1 | |
| DyMN-LWidth Multiplier (alpha)=2.02023.10 | 97.4 | |
| MNWidth Multiplier (alpha)=2.02023.10 | 96.9 | |
| PaSST-S2023.10 | 96.8 | |
| MNWidth Multiplier (alpha)=3.02023.10 | 96.8 | |
| CLAP2023.10 | 96.7 | |
| DyMN-SWidth Multiplier (alpha)=0.42023.10 | 96.4 | |
| MNWidth Multiplier (alpha)=1.02023.10 | 96.4 | |
| DyMN-MWidth Multiplier (alpha)=1.02023.10 | 96.4 | |
| AST-PAdditional audio data pre-training=true2021.04 | 95.6 | |
| CNN14Training strategy=Fine-tune2019.12 | 94.7 | |
| SOTA-PAdditional audio data pre-training=true2021.04 | 94.7 | |
| MNWidth Multiplier (alpha)=0.42023.10 | 93.2 | |
| BEATs#Param. (M)=91, Data (hrs)=5,800, Evaluation Protocol=Fine-tuning2026.04 | 92.45 | |
| CNN14Training strategy=Freeze, Classifier layers=3 fully-connected layers2019.12 | 91.8 | |
| ULTRAS#Param. (M)=89, Data (hrs)=2,000, Evaluation Protocol=Fine-tuning2026.04 | 91.15 | |
| CNN14Training strategy=Freeze, Classifier layers=1 fully-connected layer2019.12 | 90.8 | |
| Cross-AVIDPretraining DB=Audioset, Evaluation protocol=linear classification2020.04 | 89.2 | |
| AVID+CMAPretraining DB=Audioset, Evaluation protocol=linear classification2020.04 | 89.1 | |
| AST-SAdditional audio data pre-training=false2021.04 | 88.7 | |
| EnCodecMAE#Param. (M)=86.6, Data (hrs)=11,000, Evaluation Protocol=Fine-tuning2026.04 | 88.25 | |
| Sailor et al.2019.12 | 86.5 | |
| ConvRBMPretraining DB=None, Evaluation protocol=linear classification2020.04 | 86.5 | |
| SOTA-SAdditional audio data pre-training=false2021.04 | 86.5 | |
| XDCPretraining DB=Audioset, Evaluation protocol=linear classification2020.04 | 85.8 | |
| CNN14Training strategy=Scratch2019.12 | 83.3 | |
| AVTSPretraining DB=Audioset, Evaluation protocol=linear classification2020.04 | 80.6 | |
| L3Pretraining DB=Flickr-SoundNet, Evaluation protocol=linear classification2020.04 | 79.3 | |
| AVID+CMAPretraining DB=Kinetics, Evaluation protocol=linear classification2020.04 | 79.1 | |
| XDCPretraining DB=Kinetics, Evaluation protocol=linear classification2020.04 | 78.5 | |
| Cross-AVIDPretraining DB=Kinetics, Evaluation protocol=linear classification2020.04 | 77.6 | |
| HuBERT#Param. (M)=95, Data (hrs)=960, Evaluation Protocol=Fine-tuning2026.04 | 77.45 | |
| ESC50 Baseline2023.10 | 76.9 | |
| AVTSPretraining DB=Kinetics, Evaluation protocol=linear classification2020.04 | 76.7 | |
| SoundNetPretraining DB=Flickr-SoundNet, Evaluation protocol=linear classification2020.04 | 74.2 | |
| ConvNetPretraining DB=None, Evaluation protocol=linear classification2020.04 | 64.5 | |
| RandomForestPretraining DB=None, Evaluation protocol=linear classification2020.04 | 44.3 | |
| SSAST#Param. (M)=89, Data (hrs)=5,800, Evaluation Protocol=Fine-tuning2026.04 | 37.85 |