DSTC
Benchmarks
TaskDatasetSOTA resultTrendResults
DSTC7 Track 1 (test)
91.1Recall@1 (Top 100)
27
DSTC9 Interactive Dialogue Evaluation Track (test)
5Human Rating
12
DSTC7 Shared Task (test)
2.669NIST-4
8
DSTC2 (test)
48.9Average Error Rate
7
DSTC Travel domain 12 (test)
89.7Semantic Relevance (SR)
6
DSTC-12 Travel domain (blind test)
0.68Accuracy
6
DSTC 12 (test)
0.17Empathy
5
DSTC2
85Joint GA
5
DSTC 4 (test)
66.2Accuracy
4
DSTC4
61.1Slot F1
3
DSTC9 shared task Human Evaluation (test)
74.8Avg Success Rate
3