Language Modeling on MSC Session Openings 1.0 (val)
7.78PerplexitySumMem-MSC 2.7B
Evaluation Results
| Method | Links | |
|---|---|---|
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 7.78 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 7.82 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 7.95 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD-RAG2021.07 | 7.96 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=FiD2021.07 | 7.97 | |
| SumMem-MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 7.97 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Retrieval Strategy=RAG2021.07 | 8.04 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=10242021.07 | 8.06 | |
| MSC 2.7BParameters=2.7B, Architecture=encoder-decoder, Context Truncation=1282021.07 | 8.95 | |
| BST 2.7BParameters=2.7B, Architecture=encoder-decoder2021.07 | 13.04 |