Language Modeling on MSC Session 5 1.0 (val)
8.99PerplexitySumMem-MSC 2.7B
Evaluation Results
| Method | Links | |
|---|---|---|
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 8.99 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 8.99 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 9 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 9.04 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 9.04 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 9.08 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 9.09 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 9.1 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=1282021.07 | 9.23 | |
| BST 2.7BParameters=2.7B, Architecture=encoder-decoder2021.07 | 10.44 |