List your company
ResearchFormerly WizWand

Machine Translation on JRC-Acquis Es-En (dev)

68.63BLEUTransformer dual
20.99833.36445.7358.096May 3, 2023Jul 6, 2023Sep 9, 2023Nov 13, 2023Jan 17, 2024Mar 22, 2024May 26, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Transformer dualMemory Type=Self-Memory2023.0568.63
Transformer jointMemory Type=Self-Memory2023.0568.26
Transformer jointMemory Type=Retrieval2023.0567.74
MonoNMTMemory Type=Retrieval2023.0567.73
CMMMemory Type=Retrieval2023.0567.48
Transformer dualMemory Type=Retrieval2023.0566.87
G-TFMMemory Type=Retrieval2023.0566.37
TransformerMemory Type=None2023.0564.08
NMT-piecesMemory Type=Retrieval2023.0563.97
SEG-NMTMemory Type=Retrieval2023.0560.28
RNNsearchMemory Type=None2023.0555.02
M-RAG (Mixtral 8 × 7B)LLM=Mixtral 8 × 7B, RAG=M-RAG2024.0539.11
Mixtral 8 × 7B (Selfmem)LLM=Mixtral 8 × 7B, RAG=Selfmem2024.0537.65
Mixtral 8 × 7B (Self-RAG)LLM=Mixtral 8 × 7B, RAG=Self-RAG2024.0537.17
Mixtral 8 × 7B (Naive)LLM=Mixtral 8 × 7B, RAG=Naive2024.0536.64
Mixtral 8 × 7B (None)LLM=Mixtral 8 × 7B, RAG=None2024.0534.34
M-RAG (Llama 2 13B)LLM=Llama 2 13B, RAG=M-RAG2024.0530.41
M-RAG (Phi-2 2.7B)LLM=Phi-2 2.7B, RAG=M-RAG2024.0522.83