Factoid Knowledge Evaluation on TriviaQA
89.2LAMA ScoreREMIX (Random / K-Pile)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| REMIX (Random / K-Pile)Stage 1 mixing=Random Word Sequence, Stage 2 mixing=Knowledge Pile2024.11 | 89.2 | 89.6 | 86.5 | 88.4 | |
| Parameter ExpansionImplementation=LoRA adaptors2024.11 | 80.7 | 86.6 | 83 | 83.4 | |
| Weight RegularizationImplementation=Elastic Weight Consolidation (EWC)2024.11 | 7.9 | 58.5 | 80.3 | 48.9 | |
| Behavior RegularizationObjective=KL between training model vs original reference model2024.11 | 6.8 | 39 | 71 | 38.9 | |
| No Mixing2024.11 | 4.3 | 40.5 | 68.6 | 37.8 |