Summarization on Japanese Summarization (test)
13.2ROUGE-2MuMo
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MuMoEvaluation Protocol=0-shot, Backbone=Mistral 7B, Tokens/sec=64.8, Speed Up=1.93x2024.01 | 13.2 | 26.3 | |
| Vanilla DecodingEvaluation Protocol=0-shot, Backbone=Mistral 7B, Tokens/sec=33.5, Speed Up=1.00x2024.01 | 12.9 | 26.4 |