List your company

Continual Learning on MTCL-Bench

55.97AccuracyPer-task LoRA SFT
12.44623.745535.04546.3445Jul 19, 2025

Evaluation results

MethodLinks
Per-task LoRA SFTModel=Qwen3-4B Instruct, Is CL?=false2025.0755.97—
ProgPromptModel=Qwen3-4B Instruct, Is CL?=true2025.0754.85-6.12
GRIDModel=Qwen3-4B Instruct, Is CL?=true2025.0753.63-5.14
Per-task LoRA SFTModel=LLaMA-3.1 8B-Instruct, Is CL?=false2025.0751.53—
GRIDModel=LLaMA-3.1 8B-Instruct, Is CL?=true2025.0750.55-25.34
ProgPromptModel=LLaMA-3.1 8B-Instruct, Is CL?=true2025.0749.15-35.09
PretrainedModel=LLaMA-3.1 8B-Instruct, Is CL?=false2025.0745.9—
PretrainedModel=Qwen3-4B Instruct, Is CL?=false2025.0745.16—
Prompt TuningModel=LLaMA-3.1 8B-Instruct, Is CL?=true2025.0716.89-42.67
Prompt TuningModel=Qwen3-4B Instruct, Is CL?=true2025.0714.12-7.34