Summarization on Legal (Random subset)
1.06FrSrSDQwen2.5-7B-BASE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-7B-BASEBest Ckpts.=-, Evaluation Protocol=In-context learning, Demonstration=One exemplar2026.05 | 1.06 | 1.06 | 10.63 | 28.25 | |
| CPTOnly (No Vocab Adapt)Backbone=Qwen2.5-7B, Best Ckpts.=10500, Evaluation Protocol=In-context learning, Demonstration=One exemplar2026.05 | 1.06 | 1.06 | 25.68 | 69.04 | |
| Llama-3.1-8B-BASEBest Ckpts.=-, Evaluation Protocol=In-context learning, Demonstration=One exemplar2026.05 | 1.03 | 1.03 | 25.89 | 67.04 | |
| CPTOnly (No Vocab Adapt)Backbone=Llama-3.1-8B, Best Ckpts.=10000, Evaluation Protocol=In-context learning, Demonstration=One exemplar2026.05 | 1.03 | 1.03 | 25.36 | 69.05 | |
| VOCABADAPTBackbone=Qwen2.5-7B, Best Ckpts.=6500, Evaluation Protocol=In-context learning, Demonstration=One exemplar2026.05 | 1.02 | 1.02 | 24.23 | 67.89 | |
| VOCABADAPTBackbone=Llama-3.1-8B, Best Ckpts.=6500, Evaluation Protocol=In-context learning, Demonstration=One exemplar2026.05 | 1.01 | 1.01 | 25.42 | 69.14 |