Summarization on CNN/DM (test) using Tau and SR metrics
4.54TauCORAL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CORALmodel=Llama2-7B-chat, temperature=02025.02 | 4.54 | 2.62 | |
| HASSmodel=Llama2-7B-chat, temperature=02025.02 | 4.44 | 2.57 | |
| CORALmodel=Llama3-8B-Instruct, temperature=02025.02 | 4.16 | 2.2 | |
| EAGLE-2model=Llama2-7B-chat, temperature=02025.02 | 4.12 | 2.4 | |
| HASSmodel=Llama3-8B-Instruct, temperature=02025.02 | 4.06 | 2.16 | |
| EAGLE-2model=Llama3-8B-Instruct, temperature=02025.02 | 3.82 | 1.98 | |
| CORALmodel=Qwen2.5-7B-Instruct, temperature=02025.02 | 3.72 | 1.97 | |
| CORALmodel=Llama3-8B-Instruct, temperature=0, router=with router2025.02 | 3.61 | 2.16 | |
| HASSmodel=Qwen2.5-7B-Instruct, temperature=02025.02 | 3.57 | 1.9 | |
| EAGLE-2model=Qwen2.5-7B-Instruct, temperature=02025.02 | 3.33 | 1.78 | |
| CORALmodel=Qwen2.5-7B-Instruct, temperature=0, router=with router2025.02 | 3.28 | 1.99 |