List your company
ResearchFormerly WizWand

Spoken Dialogue State Tracking on MultiWOZ (test)

32.4Joint Goal AccJoint Speech and Text E2E DST
13.1618.15523.1528.145Nov 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-12B-it, Training Text=✗2025.1132.4
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-12B-it, Training Text=SW2025.1131.6
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-4B-it, Training Text=SW2025.1130.8
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-4B-it, Training Text=✗2025.1127.3
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-1B-it, Training Text=✗2025.1127.1
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-12B-it, Training Text=MW2025.1123.5
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=Gemma-3-1B-it, Training Text=SW2025.1123.5
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=OLMo-1B, Training Text=✗2025.1123.2
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-4B-it, Training Text=MW2025.1122.6
Joint Speech and Text E2E DSTTraining Speech=MW, LLM=OLMo-1B, Training Text=SW2025.1121.9
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-1B-it, Training Text=MW2025.1118.4
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=OLMo-1B, Training Text=MW2025.1118.2
OLMo-1B [7]Training Speech=MW, LLM=OLMo-1B, Training Text=✗2025.1118.2
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-4B-it, Training Text=✗2025.1116.9
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-12B-it, Training Text=✗2025.1116.6
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=Gemma-3-1B-it, Training Text=✗2025.1114.3
Joint Speech and Text E2E DSTTraining Speech=SW, LLM=OLMo-1B, Training Text=✗2025.1113.9