Machine Translation on FLoRes-200 Japanese (test)
26.3BLEUVanilla Decoding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Vanilla Decodingshots=32024.01 | 26.3 | 33.4 | 1 | |
| Spec.shots=3, draft_model=Llama-2 7B, draft_tokens=52024.01 | 26 | 34.5 | 1.03 | |
| Shortlistingshots=3, target_language_subset=mC42024.01 | 25.2 | 34.9 | 1.04 | |
| MuMoshots=32024.01 | 24.3 | 58.3 | 1.75 | |
| Spec. (w/o Rejection)shots=3, draft_model=Llama-2 7B, draft_tokens=5, rejection_module=false2024.01 | 22.7 | 39.9 | 1.21 |