Language Modeling on MSC Session 1 1.0 (val)
8.14PerplexityMSC 2.7B
Evaluation Results
| Method | Links | |
|---|---|---|
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 8.14 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 8.16 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 8.16 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 8.16 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 8.16 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 8.16 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 8.17 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 8.18 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=1282021.07 | 8.75 | |
| BST 2.7BParameters=2.7B, Architecture=encoder-decoder2021.07 | 8.84 |