Musical Instrument Classification on NSYNTH (test)
79.14AccuracyBEATs
Evaluation results
| Method | Links | |
|---|---|---|
| BEATs#Param. (M)=91, Data (hrs)=5,800, Evaluation Protocol=Fine-tuning2026.04 | 79.14 | |
| SF NFNet-F0Protocol=Linear evaluation2023.06 | 78.2 | |
| EnCodecMAE#Param. (M)=86.6, Data (hrs)=11,000, Evaluation Protocol=Fine-tuning2026.04 | 77.23 | |
| M2DProtocol=Linear evaluation2023.06 | 76.9 | |
| ULTRAS#Param. (M)=89, Data (hrs)=2,000, Evaluation Protocol=Fine-tuning2026.04 | 76.52 | |
| ATST-ClipProtocol=Linear evaluation2023.06 | 76.2 | |
| ATST-FrameProtocol=Linear evaluation2023.06 | 75.9 | |
| BYOL-AProtocol=Linear evaluation2023.06 | 74.1 | |
| BYOL-A-V2Protocol=Linear evaluation2023.06 | 73.1 | |
| HuBERT#Param. (M)=95, Data (hrs)=960, Evaluation Protocol=Fine-tuning2026.04 | 69.4 | |
| JMLAzero-shot=false, note=Used test task data during training2024.06 | 64.82 | |
| COLAProtocol=Linear evaluation2023.06 | 63.4 | |
| SSAST#Param. (M)=89, Data (hrs)=5,800, Evaluation Protocol=Fine-tuning2026.04 | 60.78 | |
| CLAP2022zero-shot=true2024.06 | 58.4 | |
| CLAP2023zero-shot=true2024.06 | 58.08 | |
| LAION-CLAPzero-shot=true2024.06 | 45.52 | |
| Wav2CLIPzero-shot=true2024.06 | 35.28 | |
| Proto-LCzero-shot=true2024.06 | 35.28 | |
| AudioCLIPzero-shot=false, note=Used test task data during training2024.06 | 27.66 | |
| M2D-CLAPmasking_ratio=0.7, zero-shot=true2024.06 | 23.39 | |
| Pengizero-shot=true2024.06 | 21.44 | |
| WavCapszero-shot=true2024.06 | 7.31 |