# End-to-End Dialogue Modeling on ToDs (test) Source: [End-to-End Dialogue Modeling on ToDs (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:47:16.099Z Evaluation of End-to-End Dialogue Modeling performance on the test split of the ToDs dataset, measured using Intent Accuracy, Dialogue State Tracking Joint Goal Accuracy (JGA), and NLG metrics (EER, BLEU). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | End-to-End Dialogue Modeling | | Dataset (including any stated split) | ToDs (test) | | Metric | Intent Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Intent Accuracy](): Higher is better; unit: PERCENT. - [DST JGA](): Higher is better; unit: PERCENT. - [NLG EER](): Lower is better; unit: PERCENT. - [NLG BLEU](): Higher is better; unit: PERCENT. ## Recorded results | Method | Intent Accuracy | Result date | Report paper | | --- | --- | --- | --- | | MULTI | 95.45 | Not recorded | 68fa73471e209131cea5b810 | | HESIT | 83.46 | Not recorded | 68fa73471e209131cea5b810 | | GSS | 81.42 | Not recorded | 68fa73471e209131cea5b810 | | UNIFORM | 80.67 | Not recorded | 68fa73471e209131cea5b810 | | RANDOM | 78.22 | Not recorded | 68fa73471e209131cea5b810 | | ARPER | 77.6 | Not recorded | 68fa73471e209131cea5b810 | | A-GEM | 11.23 | Not recorded | 68fa73471e209131cea5b810 | | LAMOL | 2.68 | Not recorded | 68fa73471e209131cea5b810 | | VANILLA | 2.65 | Not recorded | 68fa73471e209131cea5b810 | | EWC | 2.46 | Not recorded | 68fa73471e209131cea5b810 | | L2 | 2.33 | Not recorded | 68fa73471e209131cea5b810 | ### MULTI Intent Accuracy: 95.45. Result ID: 6992cf1b3a6c31484911a688. [Reporting paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"null"}. This record does not assert independent reproduction. ### HESIT Intent Accuracy: 83.46. Result ID: 6992cf1b3a6c31484911a687. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"t\|M\|"}. This record does not assert independent reproduction. ### GSS Intent Accuracy: 81.42. Result ID: 6992cf1b3a6c31484911a685. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"t\|M\|"}. This record does not assert independent reproduction. ### UNIFORM Intent Accuracy: 80.67. Result ID: 6992cf1b3a6c31484911a684. [Reporting paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"t\|M\|"}. This record does not assert independent reproduction. ### RANDOM Intent Accuracy: 78.22. Result ID: 6992cf1b3a6c31484911a683. [Reporting paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"t\|M\|"}. This record does not assert independent reproduction. ### ARPER Intent Accuracy: 77.6. Result ID: 6992cf1b3a6c31484911a686. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"t\|M\|"}. This record does not assert independent reproduction. ### A-GEM Intent Accuracy: 11.23. Result ID: 6992cf1b3a6c31484911a681. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"t\|M\|"}. This record does not assert independent reproduction. ### LAMOL Intent Accuracy: 2.68. Result ID: 6992cf1b3a6c31484911a682. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"0"}. This record does not assert independent reproduction. ### VANILLA Intent Accuracy: 2.65. Result ID: 6992cf1b3a6c31484911a67e. [Reporting paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"0"}. This record does not assert independent reproduction. ### EWC Intent Accuracy: 2.46. Result ID: 6992cf1b3a6c31484911a680. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"0"}. This record does not assert independent reproduction. ### L2 Intent Accuracy: 2.33. Result ID: 6992cf1b3a6c31484911a67f. [Reporting paper]() Recorded evaluation configuration: {"Buffer memory size (Mem.)":"0"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.