NIST
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
NIST Zh-En All (test)
39.81BLEU Score
10
NIST SD4
99.75Rank-1 Accuracy
9
NIST (test)
88.9Win Rate
9
NIST [M+H]+ adduct '20 (Scaffold split)
78.8Cosine Similarity
8
NIST [M+H]+ adduct '20 (Random split)
0.838Cosine Similarity
8
NIST 2003-2006 (test)
83.37COMET Score
8
NIST 2016 (test)
99.2AUC
8
NIST 16
80.6Accuracy
7
NIST Chinese-English (dev)
50.99BLEU
7
NIST positive mode Scaffold 2020
0.787Cosine Similarity
6
NIST positive mode 2020 (Random)
82.9Cosine Similarity
6
NIST16
87.2AUC
6
NIST Zh-En (MT08)
41.3BLEU
6
NIST Zh-En (MT02)
50.7BLEU
6
NIST Zh-En (val)
49.7BLEU
6
NIST Zh-En sacreBLEU (test)
51.07sacreBLEU
6
NIST 03-06 Average (test)
37.85BLEU
6
NIST 2020
52Top-1 Accuracy
5
NIST Positive+negative mode 20 (Scaffold)
0.785Cosine Similarity
5
NIST Positive+negative mode Random split 20
0.821Cosine Similarity
5
NIST16
87.7Pixel-level AUC
5
NIST Round0
0.16Loss (Cross-Entropy)
5
NIST
49Accuracy (Top1)
4
NIST 16
33.8F1 Score (Facebook)
4
NIST Zh-En (ALL)
48.1BLEU
3