ResearchDatasetsPretrainingPretrainingFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLanguage ModelingPretraining Dataset2.151Train Loss (PT)14Knowledge Graph CompletionPretraining 3 graphs42.3MRR4Link PredictionPretraining 3 graphs43.9MRR2