Summarization on Korean Summarization (test)
23ROUGE-2Vanilla Decoding
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla DecodingEvaluation Protocol=0-shot, Backbone=Mistral 7B, Tokens/sec=34.2, Speed Up=1.00x2024.01 | 23 | 36.5 | |
| MuMoEvaluation Protocol=0-shot, Backbone=Mistral 7B, Tokens/sec=56.4, Speed Up=1.65x2024.01 | 22.8 | 36.9 |