Continual Learning on TRACE-5000
63Overall Performance (OP)O-LoRA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| O-LoRAMethod Type=architectural, Base Model=Gemma-2 9B-it2026.06 | 63 | 61.5 | 96.9 | 0.016 | 64.6 | |
| SAEBase Model=Gemma-2 9B-it2026.06 | 54.5 | 52.9 | 95 | 0.022 | 56.7 | |
| SAE + 2% replayBase Model=Gemma-2 9B-it, Replay Buffer Percentage=2%2026.06 | 54.2 | 52.7 | 94.5 | -0.039 | 57.6 | |
| Unprotected + 2% replayBase Model=Gemma-2 9B-it, Replay Buffer Percentage=2%2026.06 | 52.7 | 51.2 | 90.7 | -0.054 | 57.4 | |
| Unprotected + 10% replayBase Model=Gemma-2 9B-it, Replay Buffer Percentage=10%2026.06 | 52.5 | 51 | 92.2 | -0.042 | 56.2 | |
| SIBase Model=Gemma-2 9B-it, Regularization Strength (λ)=12026.06 | 51.3 | 49.6 | 91.3 | 0.053 | 56.6 | |
| ELLABase Model=Gemma-2 9B-it, Regularization Strength (λ)=0.12026.06 | 47.5 | 45.9 | 85.7 | 0.096 | 57 | |
| EWCBase Model=Gemma-2 9B-it2026.06 | 44.7 | 43.1 | 98.7 | 0.006 | 45.3 | |
| MASBase Model=Gemma-2 9B-it, Variant=matched, Regularization Strength (λ)=102026.06 | 41.9 | 40.4 | 73.7 | 0.156 | 57.5 | |
| UnprotectedBase Model=Gemma-2 9B-it2026.06 | 35.1 | 33.6 | 63.4 | 0.219 | 56.9 |