Spoken Dialogue State Tracking on MultiWOZ (test)
32.4Joint Goal AccJoint Speech and Text E2E DST
Evaluation Results
| Method | Links | |
|---|---|---|
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-12B-it, Training Text=✗2025.11 | 32.4 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-12B-it, Training Text=SW2025.11 | 31.6 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-4B-it, Training Text=SW2025.11 | 30.8 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-4B-it, Training Text=✗2025.11 | 27.3 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-1B-it, Training Text=✗2025.11 | 27.1 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-12B-it, Training Text=MW2025.11 | 23.5 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-1B-it, Training Text=SW2025.11 | 23.5 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=OLMo-1B, Training Text=✗2025.11 | 23.2 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-4B-it, Training Text=MW2025.11 | 22.6 | |
| Joint Speech and Text E2E DSTTraining Speech=MW, LLM=OLMo-1B, Training Text=SW2025.11 | 21.9 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-1B-it, Training Text=MW2025.11 | 18.4 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=OLMo-1B, Training Text=MW2025.11 | 18.2 | |
| OLMo-1B [7]Training Speech=MW, LLM=OLMo-1B, Training Text=✗2025.11 | 18.2 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-4B-it, Training Text=✗2025.11 | 16.9 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-12B-it, Training Text=✗2025.11 | 16.6 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-1B-it, Training Text=✗2025.11 | 14.3 | |
| Joint Speech and Text E2E DSTTraining Speech=SW, LLM=OLMo-1B, Training Text=✗2025.11 | 13.9 |