List your company
ResearchFormerly WizWand

Bigram Language Modeling on Synthetic WebText initialization (val)

0.001Avg JSMixture KLs
-0.0121690.0766630.1654960.254328May 26, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Mixture KLsVocab=20, Objective=Mix KLs2023.050.0010
Forward KLVocab=20, Objective=For. KL2023.050.0010.0002
MIXCEVocab=20, Objective=MIXCE2023.050.0010.0002
Oracle MIXCEVocab=20, Objective=MIXCE*2023.050.00140.0001
Mixture KLsVocab=50, Objective=Mix KLs2023.050.00390.0003
Reverse KLVocab=20, Objective=Rev. KL2023.050.00390
Oracle MIXCEVocab=50, Objective=MIXCE*2023.050.00390.0003
MIXCEVocab=50, Objective=MIXCE2023.050.00430.0005
Forward KLVocab=50, Objective=For. KL2023.050.00430.0005
Mixture KLsVocab=100, Objective=Mix KLs2023.050.00920.0002
Jensen-ShannonVocab=50, Objective=JS2023.050.00920
Oracle MIXCEVocab=100, Objective=MIXCE*2023.050.00960.0002
MIXCEVocab=100, Objective=MIXCE2023.050.00970
Forward KLVocab=100, Objective=For. KL2023.050.00970.0003
Jensen-ShannonVocab=20, Objective=JS2023.050.01120
Reverse KLVocab=50, Objective=Rev. KL2023.050.03480.0001
Oracle MIXCEVocab=500, Objective=MIXCE*2023.050.04230.0001
Mixture KLsVocab=500, Objective=Mix KLs2023.050.04270.0001
MIXCEVocab=500, Objective=MIXCE2023.050.04530.0002
Forward KLVocab=500, Objective=For. KL2023.050.0460.0002
Oracle MIXCEVocab=1000, Objective=MIXCE*2023.050.07440.0001
Mixture KLsVocab=1000, Objective=Mix KLs2023.050.0750.0001
MIXCEVocab=1000, Objective=MIXCE2023.050.07940.0001
Forward KLVocab=1000, Objective=For. KL2023.050.0810.0002
Reverse KLVocab=100, Objective=Rev. KL2023.050.10
Jensen-ShannonVocab=100, Objective=JS2023.050.1730.0006
Jensen-ShannonVocab=500, Objective=JS2023.050.2780
Jensen-ShannonVocab=1000, Objective=JS2023.050.3020
Reverse KLVocab=500, Objective=Rev. KL2023.050.3050
Reverse KLVocab=1000, Objective=Rev. KL2023.050.330