List your company
ResearchFormerly WizWand

Machine Translation on JRC-Acquis De-En (dev)

65.32BLEUTransformer joint
32.965641.365349.76558.1647May 3, 2023Jul 6, 2023Sep 9, 2023Nov 13, 2023Jan 17, 2024Mar 22, 2024May 26, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Transformer jointMemory Type=Self-Memory2023.0565.32
Transformer dualMemory Type=Self-Memory2023.0565.06
Transformer jointMemory Type=Retrieval2023.0564.5
MonoNMTMemory Type=Retrieval2023.0564.48
CMMMemory Type=Retrieval2023.0564.22
Transformer dualMemory Type=Retrieval2023.0564.09
G-TFMMemory Type=Retrieval2023.0561.85
TransformerMemory Type=None2023.0560.18
NMT-piecesMemory Type=Retrieval2023.0560.1
SEG-NMTMemory Type=Retrieval2023.0555.63
RNNsearchMemory Type=None2023.0550.2
M-RAG (Mixtral 8 × 7B)LLM=Mixtral 8 × 7B, RAG=M-RAG2024.0549.16
Mixtral 8 × 7B (Selfmem)LLM=Mixtral 8 × 7B, RAG=Selfmem2024.0548.08
Mixtral 8 × 7B (Self-RAG)LLM=Mixtral 8 × 7B, RAG=Self-RAG2024.0547.99
Mixtral 8 × 7B (Naive)LLM=Mixtral 8 × 7B, RAG=Naive2024.0547.84
Mixtral 8 × 7B (None)LLM=Mixtral 8 × 7B, RAG=None2024.0543.75
M-RAG (Llama 2 13B)LLM=Llama 2 13B, RAG=M-RAG2024.0541.1
M-RAG (Phi-2 2.7B)LLM=Phi-2 2.7B, RAG=M-RAG2024.0534.21