Summarization on Japanese Summarization JA (test)
10.4ROUGE-2Vanilla Decoding
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Vanilla DecodingBackbone=Llama-1 13B, Language=Japanese, Evaluation Protocol=0-shot2024.01 | 10.4 | 21 | 28.6 | 1 | |
| MuMoBackbone=Llama-1 13B, Language=Japanese, Evaluation Protocol=0-shot2024.01 | 9.6 | 20.2 | 54.3 | 1.89 |