List your company

Knowledge Probing on TempLAMA Unchanged (22/19)

19.5EMNPM
1.0925.87110.6515.429Dec 2, 2022

Evaluation results

MethodLinks
NPM#Params=1.0x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1219.5
NPM#Params=1.0x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.1218.9
BM25 + T5#Params=2.2x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1214.9
BM25 + OPT 13B#Params=37x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.1214.8
BM25 + OPT 13B#Params=37x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1214.4
BM25 + T5#Params=2.2x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.1213.7
BM25 + T5 3B#Params=8.5x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1212
BM25 + T5 3B#Params=8.5x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.1211.9
BM25 + OPT 6.7B#Params=19x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.1210.2
BM25 + OPT 6.7B#Params=19x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.128.2
OPT 13B#Params=37x2022.124.9
OPT 6.7B#Params=19x2022.122.5
T5#Params=2.2x2022.121.9
T5 3B#Params=8.5x2022.121.8