Audio-to-Text Retrieval on Clotho (test)
38.6R@1AuroLA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AuroLARe-ranking=true2026.02 | 38.6 | 66 | — | 76.4 | |
| AuroLARe-ranking=true2026.02 | 38.6 | — | — | — | |
| SLAPEvaluation Protocol=Supervised2026.01 | 36.8 | 61.3 | — | 73.2 | |
| AuroLAPre-training (PT)=true, Re-ranking=true2026.02 | 36.7 | 59.2 | — | 70.9 | |
| AuroLAPre-training (PT)=true, Re-ranking=true2026.02 | 36.7 | — | — | — | |
| AuroLA2026.02 | 36.5 | 64.7 | — | 73.8 | |
| AuroLA2026.02 | 36.5 | — | — | — | |
| KCLLanguage=eng2025.02 | 36.34 | 64.13 | 21.36 | — | |
| CACLLanguage=eng2025.02 | 34.71 | 61.34 | 21.57 | — | |
| ML-CLAPLanguage=eng2025.02 | 34.03 | 61.05 | 21.19 | — | |
| KCLLanguage=nld2025.02 | 33.55 | 62.3 | 19.98 | — | |
| CACLLanguage=deu2025.02 | 33.36 | 58.07 | 19.49 | — | |
| KCLLanguage=spa2025.02 | 33.36 | 61.25 | 20.27 | — | |
| KCLLanguage=deu2025.02 | 33.17 | 59.61 | 19.9 | — | |
| AuroLAPre-training (PT)=true2026.02 | 32.9 | 58.2 | — | 69.8 | |
| AuroLAPre-training (PT)=true2026.02 | 32.9 | — | — | — | |
| PE-AV2026.02 | 32.7 | — | — | — | |
| PE-AV2026.02 | 32.7 | — | — | — | |
| KCLLanguage=avg2025.02 | 32.68 | 59.98 | 19.72 | — | |
| CACLLanguage=fra2025.02 | 32.4 | 58.55 | 19.85 | — | |
| CACLLanguage=spa2025.02 | 32.4 | 58.17 | 19.75 | — | |
| CACLLanguage=nld2025.02 | 32.21 | 58.65 | 19.5 | — | |
| CACLLanguage=avg2025.02 | 31.9 | 58.33 | 19.41 | — | |
| CACLLanguage=jpn2025.02 | 31.82 | 58.26 | 18.99 | — | |
| KCLLanguage=fra2025.02 | 31.82 | 60.76 | 20.02 | — | |
| ML-CLAPLanguage=deu2025.02 | 31.62 | 57.4 | 19.39 | — | |
| KCLLanguage=cat2025.02 | 31.53 | 57.98 | 18.9 | — | |
| ML-CLAPLanguage=spa2025.02 | 31.43 | 57.98 | 19.65 | — | |
| ML-CLAPLanguage=jpn2025.02 | 31.43 | 56.55 | 18.77 | — | |
| ML-CLAPLanguage=nld2025.02 | 31.4 | 57.98 | 19.58 | — | |
| ML-CLAPLanguage=avg2025.02 | 31.27 | 57.64 | 19.22 | — | |
| KCLLanguage=jpn2025.02 | 31.25 | 57.5 | 19.49 | — | |
| ML-CLAPLanguage=fra2025.02 | 30.95 | 57.59 | 19.66 | — | |
| ML-CLAPLanguage=cat2025.02 | 30.91 | 56.43 | 18.26 | — | |
| CED-LEEvaluation Protocol=Supervised2026.01 | 30.9 | 57.5 | — | 70.2 | |
| CACLLanguage=cat2025.02 | 30.67 | 56.05 | 18.67 | — | |
| KCLLanguage=zho2025.02 | 30.48 | 56.34 | 17.85 | — | |
| ML-CLAP2026.02 | 29.3 | 53.6 | — | 68 | |
| ML-CLAP2026.02 | 29.3 | — | — | — | |
| ML-CLAPLanguage=zho2025.02 | 28.41 | 56.14 | 17.26 | — | |
| ALM2VecStage=FT2026.06 | 27.9 | 52.7 | — | 66.3 | |
| CACLLanguage=zho2025.02 | 27.69 | 57.59 | 17.48 | — | |
| OnePeace2026.02 | 27.1 | 52.3 | — | 65.4 | |
| OnePeace2026.02 | 27.1 | — | — | — | |
| WavCapsEvaluation Protocol=Supervised2026.01 | 26.9 | 52.6 | — | 64.9 | |
| WavCaps-CLAPStage=FT2026.06 | 26.9 | 52.6 | — | 64.9 | |
| FineLAP2026.04 | 26.6 | 52.3 | — | 66 | |
| CacophonyEvaluation Protocol=Supervised2026.01 | 26.5 | 54.1 | — | 67.3 | |
| Cacophony2026.02 | 26.5 | 54.1 | — | 67.3 | |
| Cacophony2026.02 | 26.5 | — | — | — | |
| Cacophony2026.04 | 26.5 | 54.1 | — | 67.3 | |
| MGA-CLAP2026.04 | 26.5 | 54.1 | — | — | |
| PE-AVPre-training (PT)=true, Reproduced=true2026.02 | 26.3 | 55.2 | — | 67.2 | |
| PE-AVPre-training (PT)=true2026.02 | 26.3 | — | — | — | |
| FLAPmode=fusion2026.02 | 25.5 | 53.4 | — | 67.9 | |
| FLAPFusion=true2026.02 | 25.5 | — | — | — | |
| M2D2Evaluation Protocol=Supervised2026.01 | 24.9 | 51.6 | — | 64.5 | |
| M2D-CLAP2026.04 | 24.9 | 51.6 | — | 64.5 | |
| LAION-CLAP2026.04 | 24.4 | 49.3 | — | 65.7 | |
| LAION-CLAPEvaluation Protocol=Supervised2026.01 | 24.2 | 51.1 | — | 66.9 | |
| CLAPmode=fusion2026.02 | 24.2 | 51.1 | — | 66.9 | |
| CLAPFusion=true2026.02 | 24.2 | — | — | — | |
| CompA-CLAP2026.02 | 23.9 | 50.7 | — | 67.6 | |
| CompA-CLAP2026.02 | 23.9 | — | — | — | |
| CLAP2026.02 | 23.7 | 48.9 | — | 59.9 | |
| CLAP2026.02 | 23.7 | — | — | — | |
| SLAPEvaluation Protocol=Zero-Shot2026.01 | 23.5 | 46.6 | — | 59 | |
| WavCaps2026.02 | 23.4 | 50.9 | — | 63.4 | |
| WavCaps2026.02 | 23.4 | — | — | — | |
| HTSAT-BERT2026.04 | 23.4 | 50.9 | — | 63.4 | |
| WavCaps-CLAPStage=PT2026.06 | 23.4 | 50.9 | — | 63.4 | |
| LAION-CLAP2026.06 | 22.7 | 48.5 | — | 60.8 | |
| M-LTM2026.02 | 22.1 | 44.4 | — | 56.7 | |
| M-LTM2026.02 | 22.1 | — | — | — | |
| MS-CLAP2026.06 | 22.1 | 48.9 | — | 62 | |
| ReCLAP2026.02 | 20.5 | 45.7 | — | 58.9 | |
| ReCLAP2026.02 | 20.5 | — | — | — | |
| WavCapsEvaluation Protocol=Zero-Shot2026.01 | 20 | 43.3 | — | 56.6 | |
| VASTPre-training (PT)=true, Reproduced=true2026.02 | 20 | 40.2 | — | 53.4 | |
| VASTPre-training (PT)=true, Reproduced=true2026.02 | 20 | — | — | — | |
| DiffATR2026.02 | 18.8 | 40.4 | — | 52.7 | |
| DiffATR2026.02 | 18.8 | — | — | — | |
| M2D2Evaluation Protocol=Zero-Shot2026.01 | 18.1 | 39.9 | — | 52.5 | |
| ALM2VecStage=PT2026.06 | 17.9 | 39.4 | — | 52.2 | |
| FLAM2026.04 | 16.7 | 42.2 | — | — | |
| OnePeacePre-training (PT)=true, Reproduced=true2026.02 | 16.2 | 36.9 | — | 48.8 | |
| OnePeacePre-training (PT)=true, Reproduced=true2026.02 | 16.2 | — | — | — | |
| ASK†Protocol=Zero-shot cross-dataset, Training dataset=AudioCaps, Backbone=Global ResNet-BERT, Knowledge source=WavCaps2025.12 | 14.1 | 30.3 | — | 43.7 | |
| ASK∗Protocol=Zero-shot cross-dataset, Training dataset=AudioCaps, Backbone=Global ResNet-BERT, Knowledge source=∗2025.12 | 13.6 | 30.2 | — | 40.5 | |
| ASK+Protocol=Zero-shot cross-dataset, Training dataset=AudioCaps, Backbone=Global ResNet-BERT, Knowledge source=+2025.12 | 13.6 | 31.6 | — | 43.3 | |
| Mei et al., 2022Protocol=Zero-shot cross-dataset, Training dataset=AudioCaps, Backbone=Global ResNet-BERT2025.12 | 12.8 | 29 | — | 39.7 | |
| JINA-Embed.-v52026.06 | 10.5 | 24.7 | — | 34.3 |