Ubuntu
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Ubuntu (test)
0.886Recall@1 (Top 10)
58
Ubuntu v2 (test)
91.9MRR
20
Ubuntu (test)
0.867R@1 (R10)
18
Ubuntu IRC-16
16.04BLEU-1
12
Ubuntu v2 (test)
91.5Recall@1 (1/2 Pool)
11
Ubuntu v2
86.3R@1
9
Ubuntu (test)
91.5VI
8
Ubuntu
0P-Value
5
Ubuntu (dev)
0.534Recall@1 (R100)
2
Ubuntu Track 2 DSTC 8 (test)
44.3Precision
1
Ubuntu Track 2 DSTC 8 (test)
50.6Recall@1
1
Ubuntu Track 2 DSTC 8 (test)
64.9Recall@1
1
Ubuntu (test)
60.8Recall@1 (R100)
1