List your company
ResearchFormerly WizWand

Masked Language Modeling on SNLI (randomly sampled)

8.57PPL (U)AG
7.974811.992416.0120.0276May 24, 2023
Updated 8mo ago

Evaluation results

MethodLinks
AGBackbone=BERT-large, Masking Type=Random pairs2023.058.5710.110.0070.097
MLMBackbone=BERT-large, Masking Type=Random pairs2023.059.518.571.3740.787
AGBackbone=BERT-large, Masking Type=Contiguous pairs2023.059.6415.640.0190.173
MLMBackbone=BERT-large, Masking Type=Contiguous pairs2023.0510.42104.124.5822.463
MRFBackbone=BERT-large, Masking Type=Random pairs2023.0510.5719.540.7230.193
HCBBackbone=BERT-large, Masking Type=Random pairs2023.0510.7120.70.7970.215
AGBackbone=BERT-base, Masking Type=Random pairs2023.0510.7612.680.0070.085
MLMBackbone=BERT-base, Masking Type=Random pairs2023.0511.2219.011.080.547
MRFLBackbone=BERT-large, Masking Type=Random pairs2023.0511.5276.230.4490.276
MRFBackbone=BERT-base, Masking Type=Random pairs2023.0512.321.650.6580.179
HCBBackbone=BERT-base, Masking Type=Random pairs2023.0512.5122.620.5930.168
MRFBackbone=BERT-large, Masking Type=Contiguous pairs2023.0513.0793.331.9920.359
AGBackbone=BERT-base, Masking Type=Contiguous pairs2023.0513.2621.590.0180.181
MRFLBackbone=BERT-base, Masking Type=Random pairs2023.0513.3971.440.4330.267
MLMBackbone=BERT-base, Masking Type=Contiguous pairs2023.0513.7874.684.0141.876
HCBBackbone=BERT-large, Masking Type=Contiguous pairs2023.0514.43458.252.5630.552
MRFLBackbone=BERT-large, Masking Type=Contiguous pairs2023.0515.438,536.921.470.543
HCBBackbone=BERT-base, Masking Type=Contiguous pairs2023.0517.71589.022.0990.416
MRFBackbone=BERT-base, Masking Type=Contiguous pairs2023.0518.35126.051.9670.366
MRFLBackbone=BERT-base, Masking Type=Contiguous pairs2023.0523.4513,568.171.5430.607