List your company
ResearchFormerly WizWand

Bigram Language Modeling on Synthetic Random 50% initialization (val)

0.0005Avg JS DivergenceMixture KLs
-0.0268910.1579270.3427450.527562May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Mixture KLsVocab=20, Objective=Mix KLs2023.050.00050.0001
MIXCEVocab=20, Objective=MIXCE2023.050.00070.0001
Forward KLVocab=20, Objective=For. KL2023.050.00070.0001
Oracle MIXCEVocab=20, Objective=MIXCE*2023.050.00080.0001
Mixture KLsVocab=50, Objective=Mix KLs2023.050.00450.0003
Oracle MIXCEVocab=50, Objective=MIXCE*2023.050.00450.0004
Forward KLVocab=50, Objective=For. KL2023.050.00650.0006
MIXCEVocab=50, Objective=MIXCE2023.050.00650.0006
Mixture KLsVocab=100, Objective=Mix KLs2023.050.02740.0002
Oracle MIXCEVocab=100, Objective=MIXCE*2023.050.02850.0009
Forward KLVocab=100, Objective=For. KL2023.050.03560.0014
MIXCEVocab=100, Objective=MIXCE2023.050.03560.0014
Reverse KLVocab=20, Objective=Rev. KL2023.050.1360
Jensen-ShannonVocab=20, Objective=JS2023.050.2140
Mixture KLsVocab=500, Objective=Mix KLs2023.050.2320.0009
Oracle MIXCEVocab=500, Objective=MIXCE*2023.050.2340.0014
MIXCEVocab=500, Objective=MIXCE2023.050.2350.0015
Forward KLVocab=500, Objective=For. KL2023.050.2390.0015
Mixture KLsVocab=1000, Objective=Mix KLs2023.050.2910.0009
Oracle MIXCEVocab=1000, Objective=MIXCE*2023.050.2920.0009
MIXCEVocab=1000, Objective=MIXCE2023.050.2920.0009
Forward KLVocab=1000, Objective=For. KL2023.050.2930.0009
Reverse KLVocab=50, Objective=Rev. KL2023.050.4290.0015
Jensen-ShannonVocab=1000, Objective=JS2023.050.4590.0006
Jensen-ShannonVocab=50, Objective=JS2023.050.4740.0014
Jensen-ShannonVocab=500, Objective=JS2023.050.5340.0007
Jensen-ShannonVocab=100, Objective=JS2023.050.5530.001
Reverse KLVocab=100, Objective=Rev. KL2023.050.5570.0004
Reverse KLVocab=500, Objective=Rev. KL2023.050.6780
Reverse KLVocab=1000, Objective=Rev. KL2023.050.6850