Sound Event Detection on WildDESED (test)
0.356Score (SNR 10 dB, P1)System #2 (Ground Truth)
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| System #2 (Ground Truth)Separation=true, Text Query=Ground Truth2024.11 | 0.356 | 0.646 | 1.002 | 0.291 | 0.566 | 0.857 | 0.219 | 0.463 | 0.682 | 0.134 | 0.342 | 0.476 | 0.836 | |
| System #1Separation=false, Text Query=None2024.11 | 0.329 | 0.591 | 0.92 | 0.236 | 0.455 | 0.691 | 0.138 | 0.307 | 0.445 | 0.065 | 0.19 | 0.255 | 0.717 | |
| System #7 (Ours)Separation=true, Text Query=Ours2024.11 | 0.317 | 0.574 | 0.891 | 0.247 | 0.481 | 0.728 | 0.177 | 0.37 | 0.547 | 0.103 | 0.268 | 0.371 | 0.735 | |
| System #6 (Our w/o CL)Separation=true, Text Query=Our w/o CL2024.11 | 0.305 | 0.568 | 0.873 | 0.242 | 0.48 | 0.722 | 0.17 | 0.369 | 0.539 | 0.101 | 0.265 | 0.366 | 0.727 | |
| System #4 (Ours w/o F.T.)Separation=true, Text Query=Ours w/o F.T.2024.11 | 0.293 | 0.542 | 0.835 | 0.202 | 0.408 | 0.61 | 0.124 | 0.283 | 0.407 | 0.051 | 0.167 | 0.218 | 0.643 | |
| System #3 (All Event Texts)Separation=true, Text Query=All Event Texts2024.11 | 0.266 | 0.508 | 0.774 | 0.195 | 0.389 | 0.584 | 0.119 | 0.266 | 0.385 | 0.055 | 0.16 | 0.215 | 0.618 | |
| System #5 (Ours w/o LLM)Separation=true, Text Query=Ours w/o LLM2024.11 | 0.17 | 0.384 | 0.554 | 0.127 | 0.316 | 0.443 | 0.09 | 0.236 | 0.326 | 0.075 | 0.225 | 0.3 | 0.541 |