Factoid Knowledge Recall on Key-Value Recall Factoid
10.6ID ScoreREMIX (Random / K-Pile)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| REMIX (Random / K-Pile)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=Random / K-Pile2024.11 | 10.6 | 62.4 | 69.5 | 70.2 | 53.2 | |
| REMIX (Random / -)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=Random / -2024.11 | 8.9 | 2.5 | 42.5 | 61.4 | 28.8 | |
| REMIX (- / K-Pile)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=- / K-Pile2024.11 | 0.8 | 40 | 36.4 | 33.9 | 27.8 | |
| No MixingBackbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=No Mixing2024.11 | 0.5 | 2.1 | 17.4 | 33.8 | 13.5 | |
| REMIX (- / Random)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=- / Random2024.11 | 0.2 | 0.1 | 2.9 | 5.3 | 2.1 | |
| REMIX (K-Pile / -)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=K-Pile / -2024.11 | 0.1 | 0 | 3.2 | 30.1 | 8.4 |