# Speech-to-SQL Parsing on MASpider in-domain (test)

Source: [Speech-to-SQL Parsing on MASpider in-domain (test)](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:02:52.785Z

Evaluation of Speech-to-SQL performance on the in-domain test split of the MASpider dataset, measured using component-level metrics (SELECT, WHERE, GROUP, ORDER, AND/OR, KEYWORD) and Exact Match.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Speech-to-SQL Parsing |
| Dataset (including any stated split) | MASpider in-domain (test) |
| Metric | SELECT Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [SELECT Accuracy](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=SELECT%20Accuracy>): Higher is better; unit: PERCENT.

- [WHERE Accuracy](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=WHERE%20Accuracy>): Higher is better; unit: PERCENT.

- [GROUP Accuracy](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=GROUP%20Accuracy>): Higher is better; unit: PERCENT.

- [ORDER Accuracy](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=ORDER%20Accuracy>): Higher is better; unit: PERCENT.

- [AND/OR Accuracy](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=AND%2FOR%20Accuracy>): Higher is better; unit: PERCENT.

- [KEYWORD Accuracy](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=KEYWORD%20Accuracy>): Higher is better; unit: PERCENT.

- [Exact Match](<https://www.sota2.com/research/sota/speech-to-sql-parsing-on-maspider-in-domain-test.md?metric=Exact%20Match>): Higher is better; unit: PERCENT.

## Recorded results

| Method | SELECT Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| S2SQL-TTS | 67.4 | Not recorded | 68fa6f641e209131cea4543d |
| Wav2SQL | 63.6 | Not recorded | 68fa6f641e209131cea4543d |
| Wav2SQL (w/o Gradient reversal classifier) | 62.1 | Not recorded | 68fa6f641e209131cea4543d |
| Wav2SQL (w/o Speech reprogramming) | 59.6 | Not recorded | 68fa6f641e209131cea4543d |
| Cascaded | 58.6 | Not recorded | 68fa6f641e209131cea4543d |
| DeepSpeechSQL | 43.3 | Not recorded | 68fa6f641e209131cea4543d |

### S2SQL-TTS

SELECT Accuracy: 67.4. Result ID: 6990ba283a6c31484902c7dd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d351e209131cea386ad.md>)

[Implementation](<https://speechresearch.github.io/fastspeech2/>)

Recorded evaluation configuration: {"Synthesized data upper bound":"FastSpeech 2"}. This record does not assert independent reproduction.

### Wav2SQL

SELECT Accuracy: 63.6. Result ID: 6990ba283a6c31484902c7e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Implementation](<https://wav2sql.github.io/>)

Recorded evaluation configuration: {"Speech feature extractor":"Hubert","Language model":"GloVe"}. This record does not assert independent reproduction.

### Wav2SQL (w/o Gradient reversal classifier)

SELECT Accuracy: 62.1. Result ID: 6990ba283a6c31484902c7e2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Implementation](<https://wav2sql.github.io/>)

Recorded evaluation configuration: {"Gradient reversal classifier":"false"}. This record does not assert independent reproduction.

### Wav2SQL (w/o Speech reprogramming)

SELECT Accuracy: 59.6. Result ID: 6990ba283a6c31484902c7e1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Implementation](<https://wav2sql.github.io/>)

Recorded evaluation configuration: {"Speech reprogramming":"false"}. This record does not assert independent reproduction.

### Cascaded

SELECT Accuracy: 58.6. Result ID: 6990ba283a6c31484902c7df.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68891e209131cea1cc36.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"ASR":"wav2vec 2.0","Text-to-SQL parser":"RAT-SQL"}. This record does not assert independent reproduction.

### DeepSpeechSQL

SELECT Accuracy: 43.3. Result ID: 6990ba283a6c31484902c7de.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f641e209131cea4543d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62321e209131ce9f82cd.md>)

Recorded evaluation configuration: {"Speech encoder":"DeepSpeech"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.