List your company
ResearchFormerly WizWand

Knowledge Probing on TempLAMA Changed

20.1Exact MatchBM25 + T5
-0.3884.93110.2515.569Dec 2, 2022
Updated 8mo ago

Evaluation results

MethodLinks
BM25 + T5#Params=2.2x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1220.1
BM25 + T5 3B#Params=8.5x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1217.8
NPM#Params=1.0x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1217.5
BM25 + OPT 13B#Params=37x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1216.6
BM25 + OPT 6.7B#Params=19x, Reference Corpus=Updated Wikipedia (08/01/2022)2022.1211.3
BM25 + T5#Params=2.2x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.123
NPM#Params=1.0x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.122.9
BM25 + OPT 13B#Params=37x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.122.8
BM25 + T5 3B#Params=8.5x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.122.2
OPT 13B#Params=37x2022.122.1
BM25 + OPT 6.7B#Params=19x, Reference Corpus=Outdated Wikipedia (08/01/2019)2022.121.7
OPT 6.7B#Params=19x2022.121
T5#Params=2.2x2022.120.4
T5 3B#Params=8.5x2022.120.4