Summarization on PubMed (RougeL, BLEURT)
33.86RougeLEM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EMBackbone=Llama-8B2025.09 | 33.86 | 51.62 | |
| EMBackbone=Qwen-7B2025.09 | 30.98 | 46.1 | |
| SVSIBackbone=Llama-8B2025.09 | 29.69 | 54.03 | |
| SVSIBackbone=Qwen-7B2025.09 | 29.63 | 47.76 | |
| baseBackbone=Llama-8B2025.09 | 29.48 | 53.68 | |
| EMBackbone=Llama-3B2025.09 | 29.35 | 46.82 | |
| SJBackbone=Llama-1B2025.09 | 28.27 | 50.54 | |
| EMBackbone=Llama-1B2025.09 | 28.14 | 45.69 | |
| baseBackbone=Llama-3B2025.09 | 27.77 | 49.91 | |
| SVSIBackbone=Llama-1B2025.09 | 27.7 | 50.92 | |
| SVSIBackbone=Llama-3B2025.09 | 27.67 | 50.09 | |
| baseBackbone=Llama-1B2025.09 | 27.62 | 50.23 | |
| SJBackbone=Qwen-7B2025.09 | 23.91 | 38.95 | |
| SJBackbone=Llama-3B2025.09 | 23.01 | 43.96 | |
| baseBackbone=Qwen-7B2025.09 | 18.81 | 32.44 | |
| SJBackbone=Llama-8B2025.09 | 10.34 | 21.08 | |
| baseBackbone=Qwen-1.5B2025.09 | 0 | 0 | |
| baseBackbone=Qwen-3B2025.09 | 0 | 0 |