Language Modeling on BookSum
19.35Perplexity(w)kNN-LMa (rescore)
Evaluation Results
| Method | Links | |
|---|---|---|
| (w)kNN-LMa (rescore)LMa=domain-adapted GPT-2, datastore=pretraining, rescore=true, context_representation=LN22022.11 | 19.35 | |
| (w+a)kNN-LMa (rescore)LMa=domain-adapted GPT-2, datastore=combined, rescore=true, context_representation=LN22022.11 | 19.42 | |
| (w)kNN-LMaLMa=domain-adapted GPT-2, datastore=pretraining, context_representation=LN22022.11 | 19.72 | |
| (w+a)kNN-LMaLMa=domain-adapted GPT-2, datastore=combined, context_representation=LN22022.11 | 19.72 | |
| (w)kNN-LMLM=GPT-2, datastore=pretraining, context_representation=LN22022.11 | 20.09 | |
| (a)kNN-LMa (rescore)LMa=domain-adapted GPT-2, datastore=adaptation, rescore=true, context_representation=LN22022.11 | 20.09 | |
| (a)kNN-LMaLMa=domain-adapted GPT-2, datastore=adaptation, context_representation=LN22022.11 | 20.22 | |
| LMa (only)LMa=domain-adapted GPT-22022.11 | 20.45 | |
| (w)kNN-LMLM=GPT-2, datastore=pretraining, context_representation=original2022.11 | 20.5 | |
| (a)kNN-LMLM=GPT-2, datastore=adaptation, context_representation=original2022.11 | 20.6 | |
| LM (only)LM=GPT-22022.11 | 21.15 | |
| (w)kNN (only)datastore=pretraining2022.11 | 64.92 | |
| (a)kNN (only)datastore=adaptation2022.11 | 109.87 |