Knowledge Probing on TempLAMA Changed
20.1Exact MatchBM25 + T5
Evaluation Results
| Method | Links | |
|---|---|---|
| BM25 + T5#Params=2.2x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 20.1 | |
| BM25 + T5 3B#Params=8.5x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 17.8 | |
| NPM#Params=1.0x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 17.5 | |
| BM25 + OPT 13B#Params=37x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 16.6 | |
| BM25 + OPT 6.7B#Params=19x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 11.3 | |
| BM25 + T5#Params=2.2x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 3 | |
| NPM#Params=1.0x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 2.9 | |
| BM25 + OPT 13B#Params=37x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 2.8 | |
| BM25 + T5 3B#Params=8.5x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 2.2 | |
| OPT 13B#Params=37x2022.12 | 2.1 | |
| BM25 + OPT 6.7B#Params=19x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 1.7 | |
| OPT 6.7B#Params=19x2022.12 | 1 | |
| T5#Params=2.2x2022.12 | 0.4 | |
| T5 3B#Params=8.5x2022.12 | 0.4 |