Summarization on VNDS Vietnamese (test)
53.1ROUGE-1FreeTxt-Vi (fine-tuned Qwen2.5)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FreeTxt-Vi (fine-tuned Qwen2.5)Speed (tok/s)=112, Evaluation protocol=fine-tuned2026.03 | 53.1 | 27.5 | 48.4 | |
| Qwen2.5 (Base)Speed (tok/s)=1152026.03 | 50.4 | 25 | 46.1 | |
| Gemma-7BSpeed (tok/s)=1202026.03 | 49.6 | 24.4 | 45.3 | |
| LLaMA2-7BSpeed (tok/s)=952026.03 | 49 | 24.1 | 45 | |
| Flan-T5-baseSpeed (tok/s)=1502026.03 | 48.1 | 23.8 | 44.4 | |
| mBART50Speed (tok/s)=1102026.03 | 47.3 | 23 | 43.6 | |
| T5-baseSpeed (tok/s)=1402026.03 | 46.5 | 22.2 | 42.8 | |
| BART-largeSpeed (tok/s)=1252026.03 | 45.8 | 21.6 | 42.1 |