Summarization on Legal domain (20 random samples)
2.7CoherenceLlama-CPTOnly
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Llama-CPTOnlyBase Model=Llama, Vocabulary Adaptation=No Vocab Adapt2026.05 | 2.7 | 2.8 | 2.3 | |
| Llama-VOCABADAPTBase Model=Llama2026.05 | 2.7 | 3.6 | 3.8 | |
| Qwen-CPTOnlyBase Model=Qwen, Vocabulary Adaptation=No Vocab Adapt2026.05 | 2.6 | 1.9 | 3.6 | |
| Qwen-VOCABADAPTBase Model=Qwen2026.05 | 2.2 | 2.5 | 4.3 |