Knowledge Probing on TempLAMA Unchanged (22/19)
19.5EMNPM
Evaluation Results
| Method | Links | |
|---|---|---|
| NPM#Params=1.0x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 19.5 | |
| NPM#Params=1.0x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 18.9 | |
| BM25 + T5#Params=2.2x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 14.9 | |
| BM25 + OPT 13B#Params=37x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 14.8 | |
| BM25 + OPT 13B#Params=37x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 14.4 | |
| BM25 + T5#Params=2.2x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 13.7 | |
| BM25 + T5 3B#Params=8.5x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 12 | |
| BM25 + T5 3B#Params=8.5x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 11.9 | |
| BM25 + OPT 6.7B#Params=19x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.12 | 10.2 | |
| BM25 + OPT 6.7B#Params=19x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.12 | 8.2 | |
| OPT 13B#Params=37x2022.12 | 4.9 | |
| OPT 6.7B#Params=19x2022.12 | 2.5 | |
| T5#Params=2.2x2022.12 | 1.9 | |
| T5 3B#Params=8.5x2022.12 | 1.8 |