List your company
ResearchFormerly WizWand

Machine Translation on WMT En-De 2019 (test)

93SacreBLEUMicrosoft-WMT19-sent-doc
35.07250.11165.1580.189Jul 15, 2019Mar 31, 2020Dec 17, 2020Sep 3, 2021May 22, 2022Feb 6, 2023Oct 25, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Microsoft-WMT19-sent-docResource usage=Unconstrained2019.07930.311
Microsoft-WMT19-doc-levelResource usage=Unconstrained2019.0792.60.296
Facebook-FAIRResource usage=Constrained2019.0790.30.347
HUMANResource usage=Unconstrained2019.0790.30.24
NEUResource usage=Constrained2019.0789.60.208
UCAMResource usage=Constrained2019.0788.70.213
MSRA-MADLResource usage=Unconstrained2019.0787.60.214
MLLP-UPVResource usage=Constrained2019.0787.50.189
eTranslationResource usage=Constrained2019.0787.50.13
TartuNLP-cResource usage=Constrained2019.0787.4-0.132
JHUResource usage=Constrained2019.0787.30.081
dfki-nmtResource usage=Constrained2019.0786.80.119
Microsoft-WMT19-sent-levelResource usage=Unconstrained2019.0786.60.094
Helsinki-NLPResource usage=Constrained2019.0784.40.077
online-BResource usage=Unconstrained2019.0784.20.094
online-YResource usage=Unconstrained2019.0784.20.038
PROMT-NMTResource usage=Constrained2019.0784.10.001
lmu-ctx-tf-singleResource usage=Constrained2019.0783.70.01
online-AResource usage=Unconstrained2019.0782.8-0.072
online-GResource usage=Unconstrained2019.0782.7-0.119
UdS-DFKIResource usage=Constrained2019.0780.3-0.129
online-XResource usage=Unconstrained2019.0776.3-0.4
en-de-taskResource usage=Constrained2019.0743.3-1.769
HS-NASSearch Strategy=GPT-4, HAT, 1, 15, Latency (ms)=71.9, GFLOPS=2.99, Model Size (M)=49.6, Search Hours=2.03, GFLOPs constraint=3.02023.1043.1—
HATLatency (ms)=85.5, GFLOPS=2.99, Model Size (M)=49.6, Search Hours=2.35, GFLOPs constraint=3.02023.1042.9—
UNCSAMPBackbone=TRANSFORMER-BIG, System=This Work2021.0642.5—
SRCLMBackbone=TRANSFORMER-BIG, System=This Work2021.0641.7—
RANDSAMPBackbone=TRANSFORMER-BIG, System=This Work2021.0641.6—
MATNd/d/dh=2/512/12288, #Param (M)=314.1, rho=0.22020.0640.4—
MATNd/d/dh=2/512/12288, #Param (M)=314.1, rho=0.32020.0640.3—
Wu et al. (2019b)Data=+RANDSAMP2021.0639.8—
BITEXTBackbone=TRANSFORMER-BIG, System=This Work2021.0639.6—
MATNd/d/dh=2/512/12288, #Param (M)=314.1, rho=0.12020.0639.5—
TransformerNd/d/dh=1/1024/4096, #Param (M)=325.7, rho=02020.0639.3—
MATNd/d/dh=2/512/12288, #Param (M)=314.1, rho=02020.0638.5—
TransformerNd/d/dh=1/512/12288, #Param (M)=288.9, rho=02020.0637.4—
Wu et al. (2019b)Data=BITEXT2021.0637.3—