# Spoken Language Understanding on FSC (test)

Source: [Spoken Language Understanding on FSC (test)](<https://www.sota2.com/research/sota/spoken-language-understanding-on-fsc-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:47:16.114Z

Evaluation of Spoken Language Understanding performance on the test split of the FSC dataset, measured using WER and Intent Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Spoken Language Understanding |
| Dataset (including any stated split) | FSC (test) |
| Metric | Intent Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Intent Accuracy](<https://www.sota2.com/research/sota/spoken-language-understanding-on-fsc-test.md?metric=Intent%20Accuracy>): Higher is better; unit: PERCENT.

- [WER](<https://www.sota2.com/research/sota/spoken-language-understanding-on-fsc-test.md?metric=WER>): Lower is better; unit: PERCENT.

- [Last Accuracy](<https://www.sota2.com/research/sota/spoken-language-understanding-on-fsc-test.md?metric=Last%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Intent Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Cascaded | 100 | Not recorded | 68fa694f1e209131cea2172e |
| E2E SLP | 99.71 | Not recorded | 68fa694f1e209131cea2172e |
| E2E SLP | 99.71 | Not recorded | 68fa694f1e209131cea2172e |
| Cascaded | 99.47 | Not recorded | 68fa694f1e209131cea2172e |
| Offline | 99.28 | Not recorded | 68fa73761e209131cea5cb00 |
| E2E Joint | 99.13 | Not recorded | 68fa694f1e209131cea2172e |
| E2E SLP | 98.58 | Not recorded | 68fa694f1e209131cea2172e |
| Cascaded | 96.84 | Not recorded | 68fa694f1e209131cea2172e |
| COCONUT+S-KD | 77.57 | Not recorded | 68fa73761e209131cea5cb00 |
| COCONUT | 77.09 | Not recorded | 68fa73761e209131cea5cb00 |
| S-KD | 73.65 | Not recorded | 68fa73761e209131cea5cb00 |
| A-KD | 73.54 | Not recorded | 68fa73761e209131cea5cb00 |
| ER iCaRL | 69.76 | Not recorded | 68fa73761e209131cea5cb00 |
| T-KD | 69.08 | Not recorded | 68fa73761e209131cea5cb00 |
| ER rand | 68.61 | Not recorded | 68fa73761e209131cea5cb00 |
| Fine-tuning | 29.92 | Not recorded | 68fa73761e209131cea5cb00 |

### Cascaded

Intent Accuracy: 100. Result ID: 698da3ac8b517eb43322d48e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

Recorded evaluation configuration: {"Configurations":"Ref → BERT"}. This record does not assert independent reproduction.

### E2E SLP

Intent Accuracy: 99.71. Result ID: 698da3ac8b517eb43322d48c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

Recorded evaluation configuration: {"Configurations":"one-step (ASRU SLU)"}. This record does not assert independent reproduction.

### E2E SLP

Intent Accuracy: 99.71. Result ID: 698da3ac8b517eb43322d48d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

Recorded evaluation configuration: {"Configurations":"two-step (ASR, SLU)"}. This record does not assert independent reproduction.

### Cascaded

Intent Accuracy: 99.47. Result ID: 698da3ac8b517eb43322d490.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

Recorded evaluation configuration: {"Configurations":"SLP ASR → BERT"}. This record does not assert independent reproduction.

### Offline

Intent Accuracy: 99.28. Result ID: 6992ee163a6c3148491271ab.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

Recorded evaluation configuration: {"continual learning":false}. This record does not assert independent reproduction.

### E2E Joint

Intent Accuracy: 99.13. Result ID: 698da3ac8b517eb43322d48a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69501e209131cea21792.md>)

Recorded evaluation configuration: {"Configurations":"ASRU SLU"}. This record does not assert independent reproduction.

### E2E SLP

Intent Accuracy: 98.58. Result ID: 698da3ac8b517eb43322d48b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

Recorded evaluation configuration: {"Configurations":"one-step (SLU)"}. This record does not assert independent reproduction.

### Cascaded

Intent Accuracy: 96.84. Result ID: 698da3ac8b517eb43322d48f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa694f1e209131cea2172e.md>)

Recorded evaluation configuration: {"Configurations":"ASR → BERT"}. This record does not assert independent reproduction.

### COCONUT+S-KD

Intent Accuracy: 77.57. Result ID: 6992ee163a6c3148491271b3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### COCONUT

Intent Accuracy: 77.09. Result ID: 6992ee163a6c3148491271b2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### S-KD

Intent Accuracy: 73.65. Result ID: 6992ee163a6c3148491271b1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703c1e209131cea49cce.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### A-KD

Intent Accuracy: 73.54. Result ID: 6992ee163a6c3148491271b0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703c1e209131cea49cce.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### ER iCaRL

Intent Accuracy: 69.76. Result ID: 6992ee163a6c3148491271ae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa634e1e209131ce9fded4.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### T-KD

Intent Accuracy: 69.08. Result ID: 6992ee163a6c3148491271af.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703c1e209131cea49cce.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### ER rand

Intent Accuracy: 68.61. Result ID: 6992ee163a6c3148491271ad.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

Recorded evaluation configuration: {"buffer size":"1%"}. This record does not assert independent reproduction.

### Fine-tuning

Intent Accuracy: 29.92. Result ID: 6992ee163a6c3148491271ac.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73761e209131cea5cb00.md>)

Recorded evaluation configuration: {"continual learning":false}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
