Machine Translation on JRC-Acquis Es-En (test)
39.98BLEUM-RAG (Mixtral 8 × 7B)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| M-RAG (Mixtral 8 × 7B)LLM=Mixtral 8 × 7B, RAG=M-RAG2024.05 | 39.98 | — | — | |
| Mixtral 8 × 7B (Selfmem)LLM=Mixtral 8 × 7B, RAG=Selfmem2024.05 | 37.11 | — | — | |
| Mixtral 8 × 7B (Self-RAG)LLM=Mixtral 8 × 7B, RAG=Self-RAG2024.05 | 36.82 | — | — | |
| Mixtral 8 × 7B (Naive)LLM=Mixtral 8 × 7B, RAG=Naive2024.05 | 36.22 | — | — | |
| Mixtral 8 × 7B (None)LLM=Mixtral 8 × 7B, RAG=None2024.05 | 34.81 | — | — | |
| M-RAG (Llama 2 13B)LLM=Llama 2 13B, RAG=M-RAG2024.05 | 30.03 | — | — | |
| M-RAG (Phi-2 2.7B)LLM=Phi-2 2.7B, RAG=M-RAG2024.05 | 24.22 | — | — | |
| M-RAGLLM=Mixtral 8 x 7B2024.05 | — | 71.74 | 82.66 | |
| SelfmemLLM=Mixtral 8 x 7B2024.05 | — | 63.63 | 75.65 |