List your company

Dialogue State Tracking on Public (test)

97.98Joint Goal Accuracy (JGA)+ Stream-Only
31.014448.399765.78583.1703May 24, 2026

Evaluation results

MethodLinks
+ Stream-OnlyBackbone=Gemma3-4B2026.0597.9899.49
+ StreamDial (Hybrid)Backbone=Gemma3-4B2026.0597.9899.54
+ Seed-OnlyBackbone=Gemma3-4B2026.0597.7399.49
+ StreamDial (Hybrid)Backbone=Qwen3-1.7B2026.0596.9799.37
+ StreamDial (Hybrid)Backbone=Qwen3-8B2026.0596.7299.41
+ Stream-OnlyBackbone=Qwen3-1.7B2026.0596.4699.32
+ Stream-OnlyBackbone=Qwen3-8B2026.0595.9699.12
+ Seed-OnlyBackbone=Qwen3-8B2026.0595.7199.2
SFT w/ Public Data (Baseline)Backbone=Gemma3-4B2026.0595.7198.78
+ Seed-OnlyBackbone=Qwen3-1.7B2026.0595.4598.82
SFT w/ Public Data (Baseline)Backbone=Qwen3-8B2026.0593.9498.56
SFT w/ Public Data (Baseline)Backbone=Qwen3-1.7B2026.0593.4398.81
Zero-shot (No SFT)Backbone=Qwen3-8B2026.0554.0473.4
Zero-shot (No SFT)Backbone=Qwen3-1.7B2026.0545.7174.61
Zero-shot (No SFT)Backbone=Gemma3-4B2026.0533.5967.93