Audio Representation Evaluation on MAEB beta
55.2Any2Any RetrievalLCO-Omni-7B
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| LCO-Omni-7BParams=8.9B, Mean Rank=1, Zero Shot=—2026.04 | 55.2 | 57.1 | 1.7 | 38.4 | 67.3 | 78.7 | 64.5 | 51.9 | 52 | |
| LCO-Omni-3BParams=4.7B, Mean Rank=2, Zero Shot=—2026.04 | 54.5 | 55.4 | 1.3 | 36.8 | 66.7 | 75.4 | 62.2 | 50.3 | 50.7 | |
| Nemotron-Omni-3BParams=4.7B, Mean Rank=5, Zero Shot=—2026.04 | 38.8 | 47.6 | 1.2 | 21.1 | 66.1 | 81.5 | 69.8 | 46.6 | 43.1 | |
| BidirLM-Omni-2.5BParams=2.5B, Mean Rank=3, Zero Shot=100%2026.04 | 32.8 | 58.2 | 5.5 | 32.3 | 66.4 | 74.8 | 55.3 | 46.5 | 45.2 | |
| MS-CLAP-22Params=196M, Mean Rank=12, Zero Shot=100%2026.04 | 21.7 | 38.2 | 19.9 | 7.2 | 51.7 | 62.9 | 12.1 | 30.5 | 29.8 | |
| MS-CLAP-23Params=160M, Mean Rank=9, Zero Shot=100%2026.04 | 18.7 | 45 | 15.2 | 7 | 53.6 | 75.4 | 12.6 | 32.5 | 31.3 | |
| CLAP-unfusedParams=153M, Mean Rank=11, Zero Shot=100%2026.04 | 18.1 | 45.2 | 12.6 | 4.3 | 52.6 | 66.5 | 11.3 | 30.1 | 30.3 | |
| CLAP-fusedParams=154M, Mean Rank=10, Zero Shot=100%2026.04 | 17.6 | 44.4 | 22.7 | 4.5 | 52 | 61.3 | 13.2 | 30.8 | 30.8 | |
| SpeechT5Params=298M, Mean Rank=15, Zero Shot=100%2026.04 | 7.9 | 40.7 | 1.1 | 8.5 | 57.9 | 56.5 | 15.9 | 26.9 | 25.3 |