Machine Translation on JRC-Acquis De-En (test)
48.15BLEUM-RAG (Mixtral 8 × 7B)
Evaluation results
| Method | Links | |
|---|---|---|
| M-RAG (Mixtral 8 × 7B)LLM=Mixtral 8 × 7B, RAG=M-RAG2024.05 | 48.15 | |
| Mixtral 8 × 7B (Selfmem)LLM=Mixtral 8 × 7B, RAG=Selfmem2024.05 | 47.31 | |
| Mixtral 8 × 7B (Self-RAG)LLM=Mixtral 8 × 7B, RAG=Self-RAG2024.05 | 47.27 | |
| Mixtral 8 × 7B (Naive)LLM=Mixtral 8 × 7B, RAG=Naive2024.05 | 46.77 | |
| Mixtral 8 × 7B (None)LLM=Mixtral 8 × 7B, RAG=None2024.05 | 44.09 | |
| M-RAG (Llama 2 13B)LLM=Llama 2 13B, RAG=M-RAG2024.05 | 42.22 | |
| M-RAG (Phi-2 2.7B)LLM=Phi-2 2.7B, RAG=M-RAG2024.05 | 34.71 |