Machine Translation on JRC-Acquis Es-En (dev)
68.63BLEUTransformer dual
Evaluation Results
| Method | Links | |
|---|---|---|
| Transformer dualMemory Type=Self-Memory2023.05 | 68.63 | |
| Transformer jointMemory Type=Self-Memory2023.05 | 68.26 | |
| Transformer jointMemory Type=Retrieval2023.05 | 67.74 | |
| MonoNMTMemory Type=Retrieval2023.05 | 67.73 | |
| CMMMemory Type=Retrieval2023.05 | 67.48 | |
| Transformer dualMemory Type=Retrieval2023.05 | 66.87 | |
| G-TFMMemory Type=Retrieval2023.05 | 66.37 | |
| TransformerMemory Type=None2023.05 | 64.08 | |
| NMT-piecesMemory Type=Retrieval2023.05 | 63.97 | |
| SEG-NMTMemory Type=Retrieval2023.05 | 60.28 | |
| RNNsearchMemory Type=None2023.05 | 55.02 | |
| M-RAG (Mixtral 8 × 7B)LLM=Mixtral 8 × 7B, RAG=M-RAG2024.05 | 39.11 | |
| Mixtral 8 × 7B (Selfmem)LLM=Mixtral 8 × 7B, RAG=Selfmem2024.05 | 37.65 | |
| Mixtral 8 × 7B (Self-RAG)LLM=Mixtral 8 × 7B, RAG=Self-RAG2024.05 | 37.17 | |
| Mixtral 8 × 7B (Naive)LLM=Mixtral 8 × 7B, RAG=Naive2024.05 | 36.64 | |
| Mixtral 8 × 7B (None)LLM=Mixtral 8 × 7B, RAG=None2024.05 | 34.34 | |
| M-RAG (Llama 2 13B)LLM=Llama 2 13B, RAG=M-RAG2024.05 | 30.41 | |
| M-RAG (Phi-2 2.7B)LLM=Phi-2 2.7B, RAG=M-RAG2024.05 | 22.83 |