RWKU
Benchmarks
TaskDatasetSOTA resultTrendResults
RWKU
4.8ASG
74
RWKU Llama 3.1 8B (Forget Set)
85.9FB Score
39
RWKU (Forget Set)
85.9FB
23
RWKU
48.8Fidelity L1
22
RWKU canonical ten-subject batch
85.4FQ Score
18
RWKU MIA Set
7.154FM Score
17
RWKU Neighbor Set
64.64FB Score
17
RWKU
89.3USR
16
RWKU Llama 3.1 8B (Neighbor Set)
95.6FB
15
RWKU
85.6Forget Quality (FB)
13
RWKU MIA Set Llama 3.1 8B
2.1FM Rate
11
RWKU
38.9RAP
8
RWKU Utility Set
58.2Fac Score
6
RWKU MIA Set
228FM
6
RWKU (Neighbor Set)
95.6FB Score
6
RWKU Utility Set (MMLU, BBH, TruthfulQA, TriviaQA, AlpacaEval) 1.0
66.1Generation Score
4
RWKU
47.5FB
3