Knowledge Retention Evaluation Set
98.04Cosine SimilaritySaLoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SaLoRABase Model=Llama-3.1-70B2026.05 | 98.04 | 98.93 | 64.12 | |
| SaLoRABase Model=Mistral-7B-v0.32026.05 | 97.96 | 98.89 | 62.47 | |
| SaLoRABase Model=Qwen2.5-72B2026.05 | 97.96 | 98.71 | 67.19 | |
| SaLoRABase Model=Gemma-2-27B2026.05 | 97.36 | 98.54 | 64.28 | |
| SaLoRABase Model=Gemma-2-9b2026.05 | 97.22 | 98.92 | 64.82 | |
| SaLoRABase Model=Llama-3.1-8B2026.05 | 96.97 | 98.3 | 62.09 | |
| FMBase Model=Llama-3.1-70B2026.05 | 96.45 | 97.96 | 76.08 | |
| AEBase Model=Llama-3.1-70B2026.05 | 96.27 | 98.23 | 67.74 | |
| FMBase Model=Qwen2.5-72B2026.05 | 95.98 | 98.19 | 76.71 | |
| AEBase Model=Gemma-2-9b2026.05 | 95.61 | 97.52 | 75.22 | |
| AEBase Model=Qwen2.5-72B2026.05 | 95.46 | 98.08 | 72.34 | |
| AEBase Model=Llama-3.1-8B2026.05 | 95.28 | 97.37 | 68.94 | |
| AEBase Model=Mistral-7B-v0.32026.05 | 95.18 | 97.87 | 69 | |
| AEBase Model=Gemma-2-27B2026.05 | 94.9 | 97.46 | 78.37 | |
| FMBase Model=Mistral-7B-v0.32026.05 | 94.65 | 97.38 | 80.13 | |
| SaLoRABase Model=Qwen2.5-7B2026.05 | 94.59 | 96.93 | 62.17 | |
| FMBase Model=Gemma-2-9b2026.05 | 94.37 | 97.1 | 90.75 | |
| FMBase Model=Gemma-2-27B2026.05 | 94.35 | 97.12 | 89.76 | |
| FMBase Model=Llama-3.1-8B2026.05 | 94.33 | 96.84 | 86.99 | |
| MoEBase Model=Gemma-2-9b2026.05 | 88.2 | 94.42 | 91.66 | |
| MoEBase Model=Gemma-2-27B2026.05 | 87.68 | 94.59 | 91.83 | |
| MoEBase Model=Llama-3.1-70B2026.05 | 86.4 | 94.02 | 84.78 | |
| FMBase Model=Qwen2.5-7B2026.05 | 83.9 | 93.03 | 77.99 | |
| AEBase Model=Qwen2.5-7B2026.05 | 83.89 | 92.77 | 68.23 | |
| MoEBase Model=Mistral-7B-v0.32026.05 | 82.55 | 93.54 | 88.83 | |
| MoEBase Model=Llama-3.1-8B2026.05 | 82.44 | 92.87 | 90.15 | |
| MoEBase Model=Qwen2.5-72B2026.05 | 79.58 | 91.6 | 81.36 | |
| MoEBase Model=Qwen2.5-7B2026.05 | 75.72 | 89.42 | 82.97 | |
| MLPBase Model=Llama-3.1-70B2026.05 | 53.69 | 85.6 | 82.17 | |
| CVAEBase Model=Qwen2.5-72B2026.05 | 52.22 | 83.72 | 70.72 | |
| MLPBase Model=Gemma-2-9b2026.05 | 51.97 | 84.71 | 73.16 | |
| Safe LoRABase Model=Qwen2.5-72B2026.05 | 51.29 | 83.5 | 61.75 | |
| MLPBase Model=Qwen2.5-7B2026.05 | 50.66 | 82.96 | 78.47 | |
| MLPBase Model=Qwen2.5-72B2026.05 | 50.2 | 83.55 | 80.3 | |
| Safe LoRABase Model=Qwen2.5-7B2026.05 | 49.03 | 82.64 | 51.43 | |
| Safe LoRABase Model=Gemma-2-9b2026.05 | 48.48 | 84 | 59.78 | |
| CVAEBase Model=Llama-3.1-70B2026.05 | 48.32 | 83.27 | 55.87 | |
| Safe LoRABase Model=Llama-3.1-70B2026.05 | 48.05 | 83.45 | 52.23 | |
| CVAEBase Model=Gemma-2-9b2026.05 | 48.03 | 84.09 | 64.95 | |
| Safe LoRABase Model=Mistral-7B-v0.32026.05 | 48.01 | 83.89 | 58.11 | |
| CVAEBase Model=Mistral-7B-v0.32026.05 | 47.85 | 83.47 | 59.46 | |
| MLPBase Model=Llama-3.1-8B2026.05 | 47.32 | 83.78 | 71.66 | |
| CVAEBase Model=Gemma-2-27B2026.05 | 47.25 | 83.18 | 59.81 | |
| Safe LoRABase Model=Gemma-2-27B2026.05 | 47.14 | 83.11 | 53.37 | |
| MLPBase Model=Mistral-7B-v0.32026.05 | 47.07 | 85.2 | 75.95 | |
| MLPBase Model=Gemma-2-27B2026.05 | 47.03 | 84.48 | 76.76 | |
| Safe LoRABase Model=Llama-3.1-8B2026.05 | 45.88 | 82.77 | 54.44 | |
| CVAEBase Model=Llama-3.1-8B2026.05 | 45.74 | 83.23 | 55.36 | |
| CVAEBase Model=Qwen2.5-7B2026.05 | 45.56 | 82 | 55.33 |