Masked Language Modeling on Masked LM
3.5PPLKnowBert-W+W
Evaluation Results
| Method | Links | |
|---|---|---|
| KnowBert-W+Wmasked_lm_parameters_millions=110, KAR_parameters_millions=7.3, entity_embedding_parameters_millions=406, forward_backward_time_seconds=0.332019.09 | 3.5 | |
| KnowBert-WordNetmasked_lm_parameters_millions=110, KAR_parameters_millions=4.9, entity_embedding_parameters_millions=265, forward_backward_time_seconds=0.312019.09 | 4.1 | |
| KnowBert-Wikimasked_lm_parameters_millions=110, KAR_parameters_millions=2.4, entity_embedding_parameters_millions=141, forward_backward_time_seconds=0.272019.09 | 4.3 | |
| BERT_LARGEmasked_lm_parameters_millions=336, KAR_parameters_millions=0, entity_embedding_parameters_millions=0, forward_backward_time_seconds=0.752019.09 | 4.5 | |
| BERT_BASEmasked_lm_parameters_millions=110, KAR_parameters_millions=0, entity_embedding_parameters_millions=0, forward_backward_time_seconds=0.252019.09 | 5.5 |