List your company

Domain-specific Question Answering on sst5

1.3Relative Accuracy ImprovementLWF
0.19760.48380.771.0562May 26, 2025

Evaluation results

MethodLinks
LWFModel=Llama3-8B, Unlearning Target=dental2025.051.3—
LWFModel=Llama3-8B, Unlearning Target=mixed2025.051.06—
LWFModel=Llama3-8B, Unlearning Target=gsm8k2025.050.97—
LWFModel=Llama3-8B, Unlearning Target=qasc2025.050.74—
LWFModel=Llama3-8B, Unlearning Target=psychol2025.050.24—
Vanilla Fine-tuningModel=Llama3-8B, Unlearning Target=none2025.05—55.52