Sequential Domain Adaptation on Medical, Legal, and Code Sequential
62.7Domain ScoreStandard LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| Standard LoRABackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 62.7 | |
| SafeAnchorBackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 61.4 | |
| Safety InterleavingBackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 60.9 | |
| O-LoRABackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 60.1 | |
| EWC + LoRABackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 59.4 | |
| SafeGrad + LoRABackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 59.2 | |
| Vaccine + LoRABackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 58.6 | |
| Safe LoRABackbone=Llama-2-7B-Chat, Adaptation Protocol=Sequential (Medical → Legal → Code)2026.04 | 57.8 | |
| Base (no adapt.)Backbone=Llama-2-7B-Chat, Adaptation Protocol=No adaptation2026.04 | 38.2 |