Factoid Knowledge Recall on TriviaQA Factoid
90.8ID ScoreREMIX (- / K-Pile)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| REMIX (- / K-Pile)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=- / K-Pile2024.11 | 90.8 | 90.1 | 91.5 | 89.8 | 90.6 | |
| REMIX (Random / K-Pile)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=Random / K-Pile2024.11 | 90.2 | 89.2 | 89.6 | 86.5 | 88.9 | |
| REMIX (Random / -)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=Random / -2024.11 | 64.9 | 8.1 | 60 | 70.8 | 51 | |
| No MixingBackbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=No Mixing2024.11 | 45.6 | 4.3 | 40.5 | 68.6 | 39.8 | |
| REMIX (- / Random)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=- / Random2024.11 | 25 | 5.5 | 19.9 | 38.8 | 22.3 | |
| REMIX (K-Pile / -)Backbone=Llama-3-8B, Mixing Strategy (DM1 / DM2)=K-Pile / -2024.11 | 9.4 | 0.9 | 3.8 | 21 | 8.8 |