Language Modeling on SAMSum
31.18Perplexity(w+a)kNN-LMa (rescore)
Evaluation Results
| Method | Links | |
|---|---|---|
| (w+a)kNN-LMa (rescore)LMa=domain-adapted GPT-2, datastore=combined, rescore=true, context_representation=LN22022.11 | 31.18 | |
| (w+a)kNN-LMaLMa=domain-adapted GPT-2, datastore=combined, context_representation=LN22022.11 | 31.2 | |
| (a)kNN-LMa (rescore)LMa=domain-adapted GPT-2, datastore=adaptation, rescore=true, context_representation=LN22022.11 | 31.47 | |
| (a)kNN-LMaLMa=domain-adapted GPT-2, datastore=adaptation, context_representation=LN22022.11 | 31.48 | |
| (w)kNN-LMa (rescore)LMa=domain-adapted GPT-2, datastore=pretraining, rescore=true, context_representation=LN22022.11 | 31.92 | |
| (w)kNN-LMaLMa=domain-adapted GPT-2, datastore=pretraining, context_representation=LN22022.11 | 31.94 | |
| LMa (only)LMa=domain-adapted GPT-22022.11 | 32.26 | |
| (a)kNN-LMLM=GPT-2, datastore=adaptation, context_representation=original2022.11 | 39.99 | |
| (w)kNN-LMLM=GPT-2, datastore=pretraining, context_representation=LN22022.11 | 46.2 | |
| (w)kNN-LMLM=GPT-2, datastore=pretraining, context_representation=original2022.11 | 46.27 | |
| LM (only)LM=GPT-22022.11 | 46.86 | |
| (a)kNN (only)datastore=adaptation2022.11 | 229.89 | |
| (w)kNN (only)datastore=pretraining2022.11 | 298.08 |