Multi-sound source localization on VGGSound-Duet (test)
77.6CIoU@0.3Generation-Analysis-Refinement
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Generation-Analysis-RefinementModel category=MLLMs, N iterations=52026.04 | 77.6 | 47.2 | — | 45.8 | |
| Generation-Analysis-RefinementModel category=MLLMs, N iterations=32026.04 | 59.5 | 43.5 | — | 38.2 | |
| OA-SSLModel category=Vision Model2026.04 | 55.2 | 45.9 | — | 44.8 | |
| Proposed Method2024.03 | 46.9 | 32.5 | 44.4 | 29.2 | |
| NoPriorModel category=Vision Model2026.04 | 46.9 | 32.5 | — | 29.2 | |
| Qwen2.5-OmniModel category=MLLMs2026.04 | 42.6 | 41 | — | 28.3 | |
| T-VSLEncoders=AudioCLIP (ResNet-50 + ESResNeXt)2024.04 | 40.1 | 35.7 | — | 37.9 | |
| MiniCPM-oModel category=MLLMs2026.04 | 38.6 | 36.9 | — | 26.3 | |
| AVGNEncoders=AudioCLIP pre-trained2024.04 | 37.8 | 31.9 | — | 35.4 | |
| DSOLEncoders=AudioCLIP pre-trained2024.04 | 36.9 | — | — | 34.6 | |
| AlignmentEncoders=AudioCLIP pre-trained2024.04 | 35.8 | 30.4 | — | 33.9 | |
| Mix-and-LocalizeEncoders=AudioCLIP pre-trained2024.04 | 35.6 | 29.5 | — | 34.1 | |
| FNACEncoders=AudioCLIP pre-trained2024.04 | 35.1 | 29.8 | — | 33.4 | |
| AudioCLIPEncoders=AudioCLIP pre-trained2024.04 | 34.9 | 28.4 | — | 32.8 | |
| MarginNCEEncoders=AudioCLIP pre-trained2024.04 | 33.2 | 27.1 | — | 31.2 | |
| EZ-VSLEncoders=AudioCLIP pre-trained2024.04 | 32.4 | — | — | 30.6 | |
| LVSEncoders=AudioCLIP pre-trained2024.04 | 31.8 | — | — | 30.1 | |
| Wav2CLIPEncoders=AudioCLIP pre-trained2024.04 | 31.4 | 26.3 | — | 28.9 | |
| CoarsetoFineEncoders=AudioCLIP pre-trained2024.04 | 28.4 | — | — | 27.9 | |
| OTSEncoders=AudioCLIP pre-trained2024.04 | 26.4 | 23.9 | — | 27.5 | |
| AVGN2024.03 | 26.2 | 21.9 | 28.1 | 23.8 | |
| AVGNModel category=Vision Model2026.04 | 26.2 | 21.9 | — | 23.8 | |
| DSOL2024.03 | 22.3 | — | — | 21.1 | |
| Mix-and-Localize2024.03 | 21.1 | 16.3 | 22.6 | 20.5 | |
| Mix-and-LocalizeModel category=Vision Model2026.04 | 21.1 | 16.3 | — | 20.5 | |
| EZ-VSL2024.03 | 20.5 | — | — | 20.2 | |
| EZ-VSLModel category=Vision Model2026.04 | 20.5 | — | — | 20.2 | |
| LVS2024.03 | 17.3 | — | — | 19.5 | |
| CoarseToFIne2024.03 | 14.7 | — | — | 18.5 | |
| CoarseToFineModel category=Vision Model2026.04 | 14.7 | — | — | 18.5 | |
| InteractiveOmniModel category=MLLMs2026.04 | 14.6 | 36 | — | 17.9 | |
| DMC2024.03 | 13.8 | — | — | 17.1 | |
| DMCModel category=Vision Model2026.04 | 13.8 | — | — | 17.1 | |
| OTS2024.03 | 12.2 | 10.5 | 12.7 | 15.8 | |
| OTSModel category=Vision Model2026.04 | 12.2 | 10.5 | — | 15.8 | |
| Attention10k2024.03 | 11.5 | — | — | 15.2 | |
| Attention 10kModel category=Vision Model2026.04 | 11.5 | — | — | 15.2 |