Machine Translation on FLoRes-200 Korean (test)
21.7BLEUMuMo
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MuMoshots=32024.01 | 21.7 | 50.9 | 1.7 | |
| Spec.shots=3, draft_model=Llama-2 7B, draft_tokens=52024.01 | 21.5 | 29.2 | 0.98 | |
| Vanilla Decodingshots=32024.01 | 21.2 | 29.8 | 1 | |
| Shortlistingshots=3, target_language_subset=mC42024.01 | 19.5 | 32.7 | 1.03 | |
| Spec. (w/o Rejection)shots=3, draft_model=Llama-2 7B, draft_tokens=5, rejection_module=false2024.01 | 18.6 | 36.5 | 1.22 |