Task-Oriented Dialogue on STAR
68F1 ScoreAnyTOD XXL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AnyTOD XXLInterpretable=true, Graph Transfer=false, Evaluation Setting=(Strict) Zero-shot Transfer2025.06 | 68 | 68 | 44.3 | |
| CoDial (4o, 5-mini:l)Interpretable=true, Graph Transfer=true, Configuration=CoDialstructured2025.06 | 59.2 | 60.2 | 46.5 | |
| CoDial (4o, 4o-mini)Interpretable=true, Graph Transfer=true, Configuration=CoDialstructured2025.06 | 58.5 | 60.1 | 45.2 | |
| SGP-TODInterpretable=false, Graph Transfer=true, Evaluation Setting=(Strict) Zero-shot Transfer2025.06 | 53.5 | 53.2 | — | |
| SAMInterpretable=false, Graph Transfer=true, Evaluation Setting=(Strict) Zero-shot Transfer2025.06 | 51.2 | 49.8 | — | |
| CoDial (4o, 4o-mini) − RIInterpretable=true, Graph Transfer=true, Configuration=CoDialfree2025.06 | 36.6 | 36.1 | 23 | |
| BERT + SchemaInterpretable=false, Graph Transfer=true, Evaluation Setting=(Strict) Zero-shot Transfer2025.06 | 29.7 | 32.4 | — |