Free Q&A on LibriTTS + DEMAND mixtures Foreground
65.9ROUGE-LQwen2-Audio
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2-AudioSystem Setup=Upper Bound: Oracle Speaker + Auditory LLM2025.02 | 65.9 | 67.9 | 94.2 | |
| AAD-LLMSystem Setup=Intention-Informed AAD-LLM2025.02 | 64.2 | 65.7 | 93.8 | |
| Qwen2-AudioSystem Setup=Proposed Baseline: Extracted Speaker + Auditory LLM2025.02 | 51.5 | 52.9 | 91.6 | |
| Qwen2-AudioSystem Setup=Lower Bound: Random Speaker + Auditory LLM2025.02 | 47.1 | 48.3 | 90.7 | |
| SALMONNSystem Setup=Auditory LLM without Intention2025.02 | 44.5 | 46.5 | 90.1 | |
| Qwen2-AudioSystem Setup=Auditory LLM without Intention2025.02 | 41.5 | 42.4 | 89.6 | |
| WavLLMSystem Setup=Auditory LLM without Intention2025.02 | 39.7 | 38.1 | 89.2 | |
| LTU-ASSystem Setup=Auditory LLM without Intention2025.02 | 33.1 | 37.8 | 88.5 | |
| Qwen-AudioSystem Setup=Auditory LLM without Intention2025.02 | 31.4 | 36.3 | 87.5 | |
| GAMASystem Setup=Auditory LLM without Intention2025.02 | 23.8 | 28.5 | 86.8 |