Continual Learning on TRACE (Detailed Subtask Evaluation)
63.64C-STANCE ScoreSETA
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SETABase Model=Qwen3-4B2026.06 | 63.64 | 33 | 21.42 | 80.77 | 25.97 | 34.98 | 43.3 | -12.67 | 15.42 | |
| Full FTBase Model=LLaMA-2 7B2026.06 | 49.6 | 62.1 | 58.03 | 61.1 | 35.58 | 50.28 | 52.78 | — | — | |
| I-LoRABase Model=LLaMA-2 7B2026.06 | 33.6 | 8.1 | 14.4 | 44.2 | 22.2 | 41.4 | 27.32 | -18.3 | 18.3 | |
| SETABase Model=LLaMA-2 7B2026.06 | 27.31 | 26.41 | 20.81 | 41.63 | 22.55 | 33.62 | 28.72 | -16.33 | 19.1 | |
| I-LoRABase Model=Qwen3-4B2026.06 | 27.2 | 38.5 | 16 | 71 | 37 | 39.2 | 38.15 | -15.54 | 15.54 | |
| EWCBase Model=LLaMA-2 7B2026.06 | 19 | 24.8 | 15.2 | 42.4 | 14.8 | 41.5 | 26.28 | -22.96 | 22.96 | |
| GEMBase Model=LLaMA-2 7B2026.06 | 5.2 | 7.1 | 12 | 24 | 17.3 | 40.9 | 17.75 | -26.1 | 26.1 | |
| GEMBase Model=Qwen3-4B2026.06 | 0.5 | 13.5 | 6.5 | 67.7 | 29.6 | 38.6 | 26.07 | -32.7 | 32.7 | |
| Seq-LoRABase Model=LLaMA-2 7B2026.06 | 0.2 | 1.2 | 8.7 | 15.8 | 14.8 | 41.4 | 13.68 | -31.24 | 31.24 | |
| SeqLoRABase Model=Qwen3-4B2026.06 | 0.2 | 21.5 | 5.2 | 33.3 | 51.9 | 38.9 | 25.17 | -35.54 | 35.54 | |
| EWCBase Model=Qwen3-4B2026.06 | 0.2 | 0.6 | 4.2 | 6.4 | 46.9 | 38.6 | 16.15 | -46.54 | 46.54 |