MUSE
Benchmarks
TaskDatasetSOTA resultTrendResults
MUSE Books
-89.6Privacy Leakage
90
MUSE NEWS
58.42VerbMem (Df)
34
MUSE-News Llama 2 7B
-99.895Privacy Leakage
27
MUSE-Books 1.0 (test)
86Unlearn Score
24
MuSE (test)
62.5BERTScore F1
21
MUSE News
-99.81PrivLeak
21
MUSE (val)
48gIoU (overall)
21
MUSE forget-set
0.365Performance (BF16)
16
MUSE
1.979CAD
16
MUSE
0VerbMem on DF
16
MUSE (test)
42.3gIoU (overall)
16
MUSE Books
99.8VerbMem (No Q)
15
MUSE-Books Relearn 50%
90.974Forgetting Score (No VerbMem)
15
MUSE (forget set (Df) and retain set (Dr))
58.4VerbMem (Df)
15
MUSE News
0.011ES Unlearning
14
MUSE Books
92ES Un.
14
MUSE utility
18.4Util Score
14
MUSE (val)
56.9Overall gIoU
13
MUSE-Books Harry Potter 100 samples (forget set)
32.13R-Forget
13
MUSE books
58.4Verbosity Score
12
MUSE Books
-57.34Privacy Leak
9
MUSE Books
99.7VerbMem Dfg
9
MUSE Books
0FKM (Forget Set Knowledge Memorization)
9
MUSE News
8.3Rel Score
9
MUSE Books
7.55Rel
9