# Spoken Question Answering on MuSiQue v1.0 (test) Source: [Spoken Question Answering on MuSiQue v1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-18T08:31:53.446Z Evaluation of model performance on the test split of the MuSiQue v1.0 dataset specifically for Spoken Question Answering tasks, reporting Exact Match (EM) scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Spoken Question Answering | | Dataset (including any stated split) | MuSiQue v1.0 (test) | | Metric | Exact Match (EM) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact Match (EM)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact Match (EM) | Result date | Report paper | | --- | --- | --- | --- | | AEG (with LFE) | 53.99 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (with LFE) | 53.99 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (w/o LFE) | 53.7 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (w/o LFE) | 52.38 | Not recorded | 69ba31830636e5bf4afc075c | | baseline | 51.51 | Not recorded | 69ba31830636e5bf4afc075c | | baseline | 49.57 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (with LFE) | 48.61 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (w/o LFE) | 47.62 | Not recorded | 69ba31830636e5bf4afc075c | | baseline | 45.88 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (with LFE) | 45.72 | Not recorded | 69ba31830636e5bf4afc075c | | AEG (w/o LFE) | 44.93 | Not recorded | 69ba31830636e5bf4afc075c | | baseline | 44.72 | Not recorded | 69ba31830636e5bf4afc075c | ### AEG (with LFE) Exact Match (EM): 53.99. Result ID: 69ba62a047f34ce924a44514. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o Audio"}. This record does not assert independent reproduction. ### AEG (with LFE) Exact Match (EM): 53.99. Result ID: 69ba62a047f34ce924a4451d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LongCat-Flash-Omni"}. This record does not assert independent reproduction. ### AEG (w/o LFE) Exact Match (EM): 53.7. Result ID: 69ba62a047f34ce924a44513. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o Audio"}. This record does not assert independent reproduction. ### AEG (w/o LFE) Exact Match (EM): 52.38. Result ID: 69ba62a047f34ce924a4451c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LongCat-Flash-Omni"}. This record does not assert independent reproduction. ### baseline Exact Match (EM): 51.51. Result ID: 69ba62a047f34ce924a44512. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4o Audio"}. This record does not assert independent reproduction. ### baseline Exact Match (EM): 49.57. Result ID: 69ba62a047f34ce924a4451b. [Reporting paper]() Recorded evaluation configuration: {"Model":"LongCat-Flash-Omni"}. This record does not assert independent reproduction. ### AEG (with LFE) Exact Match (EM): 48.61. Result ID: 69ba62a047f34ce924a4451a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-Omni-30B-A3B"}. This record does not assert independent reproduction. ### AEG (w/o LFE) Exact Match (EM): 47.62. Result ID: 69ba62a047f34ce924a44519. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-Omni-30B-A3B"}. This record does not assert independent reproduction. ### baseline Exact Match (EM): 45.88. Result ID: 69ba62a047f34ce924a44518. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3-Omni-30B-A3B"}. This record does not assert independent reproduction. ### AEG (with LFE) Exact Match (EM): 45.72. Result ID: 69ba62a047f34ce924a44517. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-Omni Flash"}. This record does not assert independent reproduction. ### AEG (w/o LFE) Exact Match (EM): 44.93. Result ID: 69ba62a047f34ce924a44516. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3-Omni Flash"}. This record does not assert independent reproduction. ### baseline Exact Match (EM): 44.72. Result ID: 69ba62a047f34ce924a44515. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3-Omni Flash"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.