Task-Oriented Dialogue on MultiWOZ 2.0 (test)
99.1Inform RateDarwinTOD
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DarwinTODBackbone=GPT-5.12026.01 | 99.1 | 96.2 | 22.94 | 120.59 | — | |
| DarwinTODYear=2026, Backbone=GPT-5.12026.01 | 99.1 | 96.2 | 22.94 | 120.59 | — | |
| DarwinTODBackbone=GPT-42026.01 | 99.05 | 95.87 | 22.93 | 120.39 | — | |
| DarwinTODBackbone=Qwen3-14B2026.01 | 98.67 | 93.45 | 22.08 | 118.14 | — | |
| DarwinTODBackbone=Qwen3-8B2026.01 | 98.34 | 92.86 | 21.74 | 117.34 | — | |
| DarwinTODYear=2026, Backbone=Qwen3-8B2026.01 | 98.34 | 92.86 | 21.74 | 117.34 | — | |
| DarwinTODBackbone=Qwen2.5-14B2026.01 | 97.85 | 91.07 | 21.89 | 116.35 | — | |
| DarwinTODBackbone=Qwen2.5-7B2026.01 | 97.63 | 90.28 | 21.55 | 115.51 | — | |
| DarwinTODYear=2026, Backbone=Qwen2.5-7B2026.01 | 97.63 | 90.28 | 21.55 | 115.51 | — | |
| DarwinTODBackbone=Qwen3-4B2026.01 | 97.21 | 90.14 | 21.23 | 114.91 | — | |
| DarwinTODBackbone=Llama3-8B2026.01 | 96.92 | 89.14 | 21.83 | 114.86 | — | |
| DarwinTODYear=2026, Backbone=Llama3-8B2026.01 | 96.92 | 89.14 | 21.83 | 114.86 | — | |
| DarwinTODBackbone=Llama3.1-8B2026.01 | 96.57 | 90.19 | 21.69 | 115.07 | — | |
| UBARYear=20212026.01 | 95.4 | 80.7 | 17 | 105.05 | — | |
| AgentTODYear=2025, Status=Prev. SOTA2026.01 | 95.27 | 88.95 | 21.77 | 113.88 | — | |
| AgentTODBackbone=Llama3-8B2026.01 | 94.84 | 87.21 | 21.97 | 113 | — | |
| GALAXYYear=20222026.01 | 94.4 | 85.3 | 20.5 | 110.35 | — | |
| KMc-ToDYear=20242026.01 | 93.9 | 84.7 | 20.2 | 109.3 | — | |
| BORTYear=20222026.01 | 93.8 | 85.8 | 18.5 | 108.3 | — | |
| OmniDialogYear=20252026.01 | 92.2 | 79.3 | 18.57 | 104.32 | — | |
| AutoTODYear=20242026.01 | 91.7 | 84.4 | 10.4 | 98.5 | — | |
| ProTODYear=20252026.01 | 91.7 | 83.3 | 8.9 | 96.4 | — | |
| ProTODApproach Category=Prompting-based Approaches, Base Model=GPT-3.52026.02 | 91.7 | 83.3 | — | — | 87 | |
| DarwinTODBackbone=Qwen2.5-3B2026.01 | 90.42 | 82.17 | 18.96 | 105.26 | — | |
| PPTODYear=20222026.01 | 89.2 | 79.4 | 18.62 | 102.92 | — | |
| MarsApproach Category=Training-based Approaches2026.02 | 88.9 | 78 | — | — | — | |
| Task-Oriented FlowchartApproach Category=Flowchart-Guided Approaches, Base Model=GPT-3.52026.02 | 88.3 | 84.6 | — | — | 91.4 | |
| AutoTODApproach Category=Prompting-based Approaches, Base Model=GPT-42026.02 | 87.2 | 82.8 | — | — | 81.4 | |
| SOLOISTYear=20212026.01 | 85.5 | 72.9 | 16.54 | 95.74 | — | |
| GALAXYApproach Category=Training-based Approaches2026.02 | 85.4 | 75.7 | — | — | — | |
| MinTLYear=20202026.01 | 84.88 | 74.91 | 17.89 | 97.79 | — | |
| Task-Oriented FlowchartApproach Category=Flowchart-Guided Approaches, Base Model=LLaMA-8B2026.02 | 84.7 | 85.9 | — | — | 90.7 | |
| SimpleTODYear=20202026.01 | 84.4 | 70.1 | 15.01 | 92.26 | — | |
| SimpleTODApproach Category=Training-based Approaches2026.02 | 84.4 | 70.1 | — | — | — | |
| SGP-TODApproach Category=Prompting-based Approaches, Base Model=GPT-3.52026.02 | 83.9 | 69.9 | — | — | — | |
| SGP-TODYear=20232026.01 | 83.88 | 69.87 | 9.09 | 85.97 | — | |
| UBARApproach Category=Training-based Approaches2026.02 | 83.4 | 70.3 | — | — | — |