Sound Event Detection on DESED (test)
58.4Event-based F1Qwen2-Audio (TimePro-RL)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen2-Audio (TimePro-RL)Scale=7B, Evaluation Protocol=Post-Trained with TimePro-RL2026.04 | 58.4 | — | — | — | — | — | — | |
| Qwen2.5-Omni (TimePro-RL)Scale=7B, Evaluation Protocol=Post-Trained with TimePro-RL2026.04 | 57.6 | — | — | — | — | — | — | |
| Kimi-AudioScale=7B, Evaluation Protocol=Finetuned2026.04 | 50.9 | — | — | — | — | — | — | |
| Qwen2-AudioScale=7B, Evaluation Protocol=Finetuned2026.04 | 49.8 | — | — | — | — | — | — | |
| Qwen2.5-OmniScale=7B, Evaluation Protocol=Finetuned2026.04 | 48.9 | — | — | — | — | — | — | |
| Qwen2.5-OmniScale=7B, Evaluation Protocol=Zero-shot2026.04 | 13.7 | — | — | — | — | — | — | |
| Audio-Flaming2Scale=3B, Evaluation Protocol=Finetuned2026.04 | 8.9 | — | — | — | — | — | — | |
| Qwen2-AudioScale=7B, Evaluation Protocol=Zero-shot2026.04 | 3.4 | — | — | — | — | — | — | |
| Audio Flamingo 32026.04 | — | — | — | — | — | 51.8 | 53.7 | |
| Kimi-Audio2026.04 | — | — | — | — | — | 4 | 4.1 | |
| Qwen2-Audio2026.04 | — | — | — | — | — | 28.2 | 33.8 | |
| SpotSound-A2026.04 | — | — | — | — | — | 58 | 57.8 | |
| SpotSound-Q2026.04 | — | — | — | — | — | 66.6 | 61.1 | |
| System #1Separation=false, Text Query=None2024.11 | — | 0.5 | 0.774 | 1.274 | — | — | — | |
| System #2 (Ground Truth)Separation=true, Text Query=Ground Truth2024.11 | — | 0.44 | 0.723 | 1.163 | — | — | — | |
| System #3 (All Event Texts)Separation=true, Text Query=All Event Texts2024.11 | — | 0.431 | 0.701 | 1.132 | — | — | — | |
| System #4 (Ours w/o F.T.)Separation=true, Text Query=Ours w/o F.T.2024.11 | — | 0.437 | 0.706 | 1.143 | — | — | — | |
| System #5 (Ours w/o LLM)Separation=true, Text Query=Ours w/o LLM2024.11 | — | 0.411 | 0.669 | 1.08 | — | — | — | |
| System #6 (Our w/o CL)Separation=true, Text Query=Our w/o CL2024.11 | — | 0.432 | 0.702 | 1.134 | — | — | — | |
| System #7 (Ours)Separation=true, Text Query=Ours2024.11 | — | 0.433 | 0.703 | 1.136 | — | — | — | |
| TimeAudio2026.04 | — | — | — | — | — | 4 | 19.3 |