Machine Translation on IWSLT en-ja 17
41.22ROUGE-LLongGuide
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LongGuidebackbone=ChatGPT, shots=02025.06 | 41.22 | 8.11 | |
| LongGuidebackbone=ChatGPT, shots=32025.06 | 38.43 | 7.91 | |
| APObackbone=ChatGPT, shots=02025.06 | 37.74 | 7.44 | |
| ChatGPTshots=02025.06 | 36.13 | 7.62 | |
| APObackbone=ChatGPT, shots=32025.06 | 33.72 | 7.31 | |
| ChatGPTshots=32025.06 | 31.93 | 7.25 | |
| LongGuidebackbone=Mistral-it (0.2), shots=32025.06 | 16.62 | 3.4 | |
| LongGuidebackbone=Mistral-it (0.2), shots=02025.06 | 16.53 | 3.45 | |
| APObackbone=Mistral-it (0.2), shots=02025.06 | 14.45 | 2.91 | |
| APObackbone=Mistral-it (0.2), shots=32025.06 | 14.08 | 2.92 | |
| Mistral-it (0.2)shots=02025.06 | 13.12 | 2.82 | |
| Mistral-it (0.2)shots=32025.06 | 12.69 | 2.66 |