Continual Instruction Tuning on CoIN Avg
82.36SciQAMulti-task
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Multi-taskReplay=N/A2026.05 | 82.36 | 89.63 | 52.51 | 65.83 | 61.27 | 59.93 | 65.67 | 62.03 | 67.4 | |
| OctopusReplay=false, Category=Regularization-based2026.05 | 81.73 | 84.73 | 52.3 | 62.83 | 57.77 | 62.08 | 67.36 | 64.72 | 66.69 | |
| HiDe-LLaVAReplay=false, Category=Architecture-based2026.05 | 74.92 | 76.72 | 51.24 | 61.84 | 57.13 | 62.83 | 68.15 | 64.76 | 64.7 | |
| O-LoRAReplay=false, Category=Regularization-based2026.05 | 73.32 | 68.37 | 50.26 | 61.12 | 57.75 | 60.96 | 65.71 | 63.31 | 62.6 | |
| L2PReplay=false, Category=Architecture-based2026.05 | 70.52 | 26.89 | 45.53 | 45.21 | 56.84 | 59.03 | 63.52 | 64.11 | 53.96 | |
| Zero-shotReplay=N/A2026.05 | 69.79 | 9.93 | 45.5 | 58.47 | 57.75 | 60.77 | 66.5 | 64.93 | 54.21 | |
| MoELoRAReplay=false, Category=Architecture-based2026.05 | 68.38 | 48.5 | 44.22 | 40.23 | 55.62 | 57.04 | 62.14 | 65.75 | 55.24 | |
| LwFReplay=false, Category=Regularization-based2026.05 | 65.2 | 40.63 | 43.22 | 40.05 | 56.23 | 54.67 | 60.64 | 65.12 | 53.22 | |
| EWCReplay=false, Category=Regularization-based2026.05 | 65.11 | 40.89 | 44.09 | 39.67 | 54.92 | 56.03 | 61.12 | 64.55 | 53.3 | |
| Sequential FinetuneReplay=N/A2026.05 | 64.22 | 40.13 | 43.87 | 38.32 | 55.04 | 55.89 | 60.61 | 64.78 | 52.86 |