Audio Classification on VGG-Sound
88.15Top-1 AccuracyCALM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CALMBackbone=Qwen2-Audio, Pseudo-Labeling=false2026.02 | 88.15 | — | — | — | — | — | |
| CALMBackbone=Qwen2.5-Omni, Pseudo-Labeling=false2026.02 | 87.85 | — | — | — | — | — | |
| CALMBackbone=Qwen2-Audio, Pseudo-Labeling=true2026.02 | 87.67 | — | — | — | — | — | |
| SAVsBackbone=Qwen2.5-Omni, Pseudo-Labeling=false2026.02 | 87.11 | — | — | — | — | — | |
| CALMBackbone=Qwen2.5-Omni, Pseudo-Labeling=true2026.02 | 86.28 | — | — | — | — | — | |
| SAVsBackbone=Qwen2-Audio, Pseudo-Labeling=true2026.02 | 85.65 | — | — | — | — | — | |
| SAVsBackbone=Qwen2-Audio, Pseudo-Labeling=false2026.02 | 85.64 | — | — | — | — | — | |
| SAVsBackbone=Qwen2.5-Omni, Pseudo-Labeling=true2026.02 | 81.78 | — | — | — | — | — | |
| Zero-shotBackbone=Qwen2-Audio2026.02 | 72.94 | — | — | — | — | — | |
| Zero-shotBackbone=Qwen2.5-Omni2026.02 | 61.57 | — | — | — | — | — | |
| ONE-PEACEEvaluation Protocol=Fine-Tuning, Input Modality=Audio Only2023.05 | 59.6 | — | — | — | — | — | |
| SOTA [135]Evaluation Protocol=Fine-Tuning, Input Modality=Audio Only2023.05 | 59.5 | — | — | — | — | — | |
| SAM-2.7Br=256, Conn.=(a), Experiment=E62025.09 | 57 | — | — | — | — | — | |
| SAM-2.7Br=256, Conn.=(b), Ablation=4.2, Experiment=E142025.09 | 56.7 | — | — | — | — | — | |
| SAM-2.7Br=256, Conn.=(c), Ablation=4.2, Experiment=E152025.09 | 56.7 | — | — | — | — | — | |
| SAM-2.7Br=8, Conn.=(a), Experiment=E32025.09 | 56.6 | — | — | — | — | — | |
| MTC (AudioSet)Label=Tag, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 56.46 | — | — | — | — | — | |
| SAM-780Mr=256, Conn.=(c), Ablation=4.2, Experiment=E132025.09 | 56.2 | — | — | — | — | — | |
| SAM-780Mr=256, Conn.=(a), Experiment=E52025.09 | 56.1 | — | — | — | — | — | |
| SAM-780Mr=256, Conn.=(b), Ablation=4.2, Experiment=E122025.09 | 55.7 | — | — | — | — | — | |
| SAM-2.7Br=256, Conn.=(a), Ablation=4.3, Experiment=E182025.09 | 55.6 | — | — | — | — | — | |
| LAION-CLAPEvaluation Protocol=Fine-Tuning, Input Modality=Audio Only, reproduced=true2023.05 | 55.1 | — | — | — | — | — | |
| SAM-780Mr=8, Conn.=(a), Experiment=E22025.09 | 54.5 | — | — | — | — | — | |
| SAM-780Mr=256, Conn.=(a), Ablation=4.3, Experiment=E172025.09 | 54.4 | — | — | — | — | — | |
| SAM-2.7Br=256, Conn.=(a), Ablation=4.1, Experiment=E92025.09 | 54.3 | — | — | — | — | — | |
| SAM-130Mr=256, Conn.=(a), Experiment=E42025.09 | 53.5 | — | — | — | — | — | |
| SAM-780Mr=256, Conn.=(a), Ablation=4.1, Experiment=E82025.09 | 53.3 | — | — | — | — | — | |
| SAM-130Mr=256, Conn.=(b), Ablation=4.2, Experiment=E102025.09 | 53.1 | — | — | — | — | — | |
| SAM-130Mr=256, Conn.=(c), Ablation=4.2, Experiment=E112025.09 | 52.9 | — | — | — | — | — | |
| Absolute SOTAReference=[36]2023.05 | 52.5 | — | — | — | — | — | |
| MBT2023.12 | 52.3 | — | — | — | — | — | |
| GAMA-7Br=8, Conn.=QFormer2025.09 | 52.2 | — | — | — | — | — | |
| SAM-130Mr=8, Conn.=(a), Experiment=E12025.09 | 51.8 | — | — | — | — | — | |
| SAM-130Mr=256, Conn.=(a), Ablation=4.3, Experiment=E162025.09 | 51.7 | — | — | — | — | — | |
| ssLALM-2.8Br=8, Conn.=Linear2025.09 | 51 | — | — | — | — | — | |
| LTU-7Br=8, Conn.=Linear2025.09 | 50.3 | — | — | — | — | — | |
| SAM-130Mr=256, Conn.=(a), Ablation=4.1, Experiment=E72025.09 | 48.1 | — | — | — | — | — | |
| UIO-2XXLModel Size=XXL2023.12 | 47.7 | — | — | — | — | — | |
| Wav2CLIPEvaluation Protocol=Fine-Tuning, Input Modality=Audio Only2023.05 | 46.6 | — | — | — | — | — | |
| LAION-CLAPEvaluation Protocol=Zero-shot (No fine-tuning), Augmentation Strategy=keyword-to-caption2023.04 | 46.2 | — | — | — | — | — | |
| UIO-2XLModel Size=XL2023.12 | 44.2 | — | — | — | — | — | |
| Contrastive-scratchLabel=Caption, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 43.78 | — | — | — | — | — | |
| B.3Evaluation Protocol=Zero-shot (No fine-tuning), Variant=Monolingual (EN)2023.04 | 43.49 | — | — | — | — | — | |
| B.5Evaluation Protocol=Zero-shot (No fine-tuning), Variant=Multilingual (+EFJ)2023.04 | 42.96 | — | — | — | — | — | |
| BLATEvaluation Protocol=Zero-shot (No fine-tuning)2023.04 | 42.9 | — | — | — | — | — | |
| B.4Evaluation Protocol=Zero-shot (No fine-tuning), Variant=Bilingual2023.04 | 41.95 | — | — | — | — | — | |
| Multi-Task (Ours)Label=Tag*, Caption*, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 40.81 | — | — | — | — | — | |
| Contrastive-scratch (Ours)Label=Caption*, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 40.78 | — | — | — | — | — | |
| Captioning-scratch (Ours)Label=Caption*, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 39.78 | — | — | — | — | — | |
| PAR (Ours-UTS)Label=Tag Sequence*, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 39.59 | — | — | — | — | — | |
| Captioning-scratchLabel=Caption, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 39.52 | — | — | — | — | — | |
| LanguageBindSize=Large, Evaluation Protocol=Full tuning2023.10 | 38.6 | — | — | — | — | — | |
| UIO-2LModel Size=L2023.12 | 37.8 | — | — | — | — | — | |
| MTC (Ours-UTS)Label=Tag*, Evaluation Protocol=linear probing, Pooling Strategy=mean-pooling2026.03 | 37.7 | — | — | — | — | — | |
| PMRLsetting=zero-shot2025.07 | 36.43 | — | — | — | — | — | |
| GRAMsetting=zero-shot2025.07 | 34.58 | — | — | — | — | — | |
| VASTsetting=zero-shot2025.07 | 33.58 | — | — | — | — | — | |
| WavLink-Smallmode=zero-shot2026.01 | 31.8 | — | — | — | — | — | |
| MGA-CLAPmode=zero-shot2026.01 | 31.8 | — | — | — | — | — | |
| ViT-LENS_Lanchor=I+T2023.11 | 31.7 | — | — | — | — | — | |
| WavLink-Largemode=zero-shot2026.01 | 31.7 | — | — | — | — | — | |
| ImageBindsetting=zero-shot2025.07 | 30.98 | — | — | — | — | — | |
| ReCLAPmode=zero-shot2026.01 | 29.2 | — | — | — | — | — | |
| SOTA [89]2023.11 | 29.1 | — | — | — | — | — | |
| LAION-CLAPmode=zero-shot2026.01 | 29.1 | — | — | — | — | — | |
| LanguageBindSize=Large, Evaluation Protocol=Zero-shot2023.10 | 28.9 | — | — | — | — | — | |
| ViT-LENS_Lanchor=I2023.11 | 28.2 | — | — | — | — | — | |
| ImageBindSize=Huge, Evaluation Protocol=Zero-shot2023.10 | 27.8 | — | — | — | — | — | |
| ImageBind-Hanchor=I2023.11 | 27.8 | — | — | — | — | — | |
| IMAGEBINDZero-shot=true, Text Prompting=true2023.05 | 27.8 | — | — | — | — | — | |
| WavLink-Basemode=zero-shot2026.01 | 27.7 | — | — | — | — | — | |
| AF-CLAPmode=zero-shot2026.01 | 24.1 | — | — | — | — | — | |
| MBT (AV)Modality=Audio-Visual2022.10 | 0.641 | 0.856 | — | — | — | — | |
| PlayItBackX3Modality=Audio2022.10 | 0.537 | 0.792 | 0.561 | 0.978 | 2.846 | — | |
| Slow-FastModality=Audio2022.10 | 0.524 | 0.781 | 0.544 | 0.974 | 2.761 | — | |
| MBT (A)Modality=Audio2022.10 | 0.523 | 0.781 | — | — | — | — | |
| PolyViTModality=Audio-Visual2022.10 | 0.517 | — | — | — | — | — | |
| Chen et al.Modality=Audio2022.10 | 0.51 | 0.764 | 0.532 | 0.973 | 2.735 | — | |
| Peng et al. (AV)Modality=Audio-Visual2022.10 | 0.506 | — | 0.539 | — | — | — | |
| ResNet-101Modality=Audio2022.10 | 0.456 | 0.723 | 0.476 | 0.968 | 2.615 | — | |
| Peng et al. (A)Modality=Audio2022.10 | 0.443 | — | 0.484 | — | — | — | |
| McDonnell & GaoModality=Audio2022.10 | 0.397 | 0.716 | 0.403 | 0.963 | 2.532 | — | |
| RandomZero-shot=true2023.05 | 0.32 | — | — | — | — | — | |
| A-RWKV-B/16Training Protocol=from-scratch, Precision=bf162025.09 | — | — | — | — | — | 45.37 | |
| AST-B/16Training Protocol=from-scratch2025.09 | — | — | — | — | — | 37.25 | |
| AST-B/16Training Protocol=from-scratch, Precision=bf162025.09 | — | — | — | — | — | 39.88 | |
| AuM-B/16Training Protocol=from-scratch2025.09 | — | — | — | — | — | 42.58 | |
| CacophonyEvaluation Protocol=Zero-shot, Template=The sound of {}2026.04 | — | — | — | — | — | 27 | |
| FineLAPEvaluation Protocol=Zero-shot, Template=The sound of {}2026.04 | — | — | — | — | — | 31.5 | |
| FLAMEvaluation Protocol=Zero-shot, Template=The sound of {}2026.04 | — | — | — | — | — | 39.3 | |
| HTSAT-BERTEvaluation Protocol=Zero-shot, Template=The sound of {}2026.04 | — | — | — | — | — | 29.6 | |
| LAION-CLAPEvaluation Protocol=Zero-shot, Template=The sound of {}2026.04 | — | — | — | — | — | 29.1 | |
| MGA-CLAPEvaluation Protocol=Zero-shot, Template=The sound of {}2026.04 | — | — | — | — | — | 31.8 |