List your company

Domain-specific Question Answering on dental (Accuracy, Relative Accuracy Improvement (%))

0.78Relative Accuracy Improvement (%)LWF
-3.2136-2.1768-1.14-0.1032May 26, 2025

Evaluation results

MethodLinks
LWFModel=Llama3-8B, Unlearning Target=gsm8k2025.050.78—
LWFModel=Llama3-8B, Unlearning Target=mixed2025.050.78—
LWFModel=Llama3-8B, Unlearning Target=sst52025.050—
LWFModel=Llama3-8B, Unlearning Target=psychol2025.05-0.14—
LWFModel=Llama3-8B, Unlearning Target=qasc2025.05-3.06—
Vanilla Fine-tuningModel=Llama3-8B, Unlearning Target=none2025.05—49.39