Language Modeling on MSC Session 3 1.0 (val)
8.96PerplexitySumMem-MSC 2.7B
Evaluation Results
| Method | Links | |
|---|---|---|
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 8.96 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 8.97 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 8.98 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 9.02 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 9.02 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 9.05 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 9.06 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 9.07 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=1282021.07 | 9.22 | |
| BST 2.7BParameters=2.7B, Architecture=encoder-decoder2021.07 | 10.44 |