List your company

Knowledge Graph Prediction on JerichoWorld 1.0 (val test)

48.31Zork1 ScoreQ*BERT (Question Answering)
1.936413.975726.01538.0543Jun 17, 2021

Evaluation results

MethodLinks
Q*BERT (Question Answering)Granularity=Token (Tok.), Metric Type=F12021.0648.31——52.7663.2186.1869.5449.8260.959.8449.1755.74
WorldformerGranularity=Token (Tok.), Metric Type=F12021.0648.12——41.9859.1362.224952.2451.2950.0454.9652.45
Q*BERT (Question Answering)Granularity=Token (Tok.), Metric Type=EM2021.0643.93——49.7860.2885.8165.0249.4457.589.3148.9853.58
WorldformerGranularity=Token (Tok.), Metric Type=EM2021.0642.88——41.9854.3962.224950.851.2950.0453.8151.32
GATA-WGranularity=Token (Tok.), Metric Type=F12021.0633.93——34.8625.838.6839.5938.8837.1632.4843.9737.1
GATA-WGranularity=Token (Tok.), Metric Type=EM2021.0633.09——33.8825.6434.6437.7135.8135.9432.4840.8935.31
GATA-WGranularity=Graph (Gr.), Metric Type=F12021.0625.34——26.4722.1426.5427.632724.5523.7624.9225.19
Q*BERT (Question Answering)Granularity=Graph (Gr.), Metric Type=F12021.0624.88——31.4636.2341.8530.1226.2646.744.6639.8635.48
Q*BERT (Question Answering)Granularity=Graph (Gr.), Metric Type=EM2021.0624.56——29.1434.4541.2228.9622.1741.444.4236.8432.79
WorldformerGranularity=Graph (Gr.), Metric Type=F12021.0624.44——34.3944.5352.4334.342.241.6542.7445.1741.06
GATA-WGranularity=Graph (Gr.), Metric Type=EM2021.0622.3——24.7221.7223.6822.812724.5523.7624.5224.06
WorldformerGranularity=Graph (Gr.), Metric Type=EM2021.0621.62——34.3941.0550.413041.5640.141.8742.4339.15
Seq2SeqGranularity=Token (Tok.), Metric Type=F12021.0621.12——20.8435.8618.8627.7217.8715.4213.2524.3419.96
Seq2SeqGranularity=Token (Tok.), Metric Type=EM2021.0618.01——20.2635.8617.625.4817.1914.813.2522.4818.8
Seq2SeqGranularity=Graph (Gr.), Metric Type=F12021.0612.96——18.8929.489.0423.5416.8914.1810.4718.5215.54
Seq2SeqGranularity=Graph (Gr.), Metric Type=EM2021.0612.44——18.4226.868.1922.1816.8912.948.3816.4814.29
RulesGranularity=Token (Tok.), Metric Type=F12021.068.42——26.7410.2336.0923.3621.7418.483.869.4417.5
RulesGranularity=Token (Tok.), Metric Type=EM2021.066.08——10.337.5132.5316.4814.414.473.347.4213.08
RulesGranularity=Graph (Gr.), Metric Type=F12021.064.46——12.874.5511.910.2210.068.370.643.367.25
RulesGranularity=Graph (Gr.), Metric Type=EM2021.063.72——7.611.399.176.444.945.10.492.484.7