Language Modeling on MSC Session 2 1.0 (val)
9.08PerplexitySumMem-MSC 2.7B
Evaluation Results
| Method | Links | |
|---|---|---|
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 9.08 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 9.09 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 9.11 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 9.13 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 9.14 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 9.16 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 9.18 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 9.19 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=1282021.07 | 9.32 | |
| BST 2.7BParameters=2.7B, Architecture=encoder-decoder2021.07 | 10.56 |