# Spoken Language Understanding on in-house SLU dataset

Source: [Spoken Language Understanding on in-house SLU dataset](<https://www.sota2.com/research/sota/spoken-language-understanding-on-in-house-slu-dataset>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:59:48.293Z

Evaluation of Spoken Language Understanding performance on the proprietary in-house SLU dataset, measured using RI-ICER and RI-IRER metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Spoken Language Understanding |
| Dataset (including any stated split) | in-house SLU dataset |
| Metric | RI-ICER |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [RI-ICER](<https://www.sota2.com/research/sota/spoken-language-understanding-on-in-house-slu-dataset.md?metric=RI-ICER>): Lower is better; unit: PERCENT.

- [RI-IRER](<https://www.sota2.com/research/sota/spoken-language-understanding-on-in-house-slu-dataset.md?metric=RI-IRER>): Lower is better; unit: PERCENT.

## Recorded results

| Method | RI-ICER | Result date | Report paper |
| --- | --- | --- | --- |
| FANS-c | 0 | Not recorded | 68fa6b2e1e209131cea2caa0 |
| FANS-b | 22 | Not recorded | 68fa6b2e1e209131cea2caa0 |
| FANS-a | 25 | Not recorded | 68fa6b2e1e209131cea2caa0 |
| A2I- multi-task | 30 | Not recorded | 68fa6b2e1e209131cea2caa0 |
| A2I-direct-model | 39 | Not recorded | 68fa6b2e1e209131cea2caa0 |
| Joint ASR NLU | 47 | Not recorded | 68fa6b2e1e209131cea2caa0 |

### FANS-c

RI-ICER: 0. Result ID: 698e6b43ffc3901de09d720b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

Recorded evaluation configuration: {"Encoder":"SA","Decoder":"SA","Attender":"CA","Size (M)":"30"}. This record does not assert independent reproduction.

### FANS-b

RI-ICER: 22. Result ID: 698e6b43ffc3901de09d720a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

Recorded evaluation configuration: {"Encoder":"LSTM","Decoder":"SA","Attender":"CA","Size (M)":"30"}. This record does not assert independent reproduction.

### FANS-a

RI-ICER: 25. Result ID: 698e6b43ffc3901de09d7209.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

Recorded evaluation configuration: {"Encoder":"LSTM","Decoder":"LSTM","Attender":"AA","Size (M)":"31"}. This record does not assert independent reproduction.

### A2I- multi-task

RI-ICER: 30. Result ID: 698e6b43ffc3901de09d7207.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69501e209131cea21792.md>)

Recorded evaluation configuration: {"Encoder":"LSTM","Decoder":"LSTM","Attender":"AA","Size (M)":"31"}. This record does not assert independent reproduction.

### A2I-direct-model

RI-ICER: 39. Result ID: 698e6b43ffc3901de09d7208.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69501e209131cea21792.md>)

Recorded evaluation configuration: {"Encoder":"LSTM","Decoder":"LSTM","Attender":"AA","Size (M)":"29"}. This record does not assert independent reproduction.

### Joint ASR NLU

RI-ICER: 47. Result ID: 698e6b43ffc3901de09d720c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b2e1e209131cea2caa0.md>)

Recorded evaluation configuration: {"Encoder":"SA","Decoder":"SA","Attender":"CA","Size (M)":"30"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.