Masked Language Modeling on SNLI (randomly sampled)
8.57PPL (U)AG
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AGBackbone=BERT-large, Masking Type=Random pairs2023.05 | 8.57 | 10.11 | 0.007 | 0.097 | |
| MLMBackbone=BERT-large, Masking Type=Random pairs2023.05 | 9.5 | 18.57 | 1.374 | 0.787 | |
| AGBackbone=BERT-large, Masking Type=Contiguous pairs2023.05 | 9.64 | 15.64 | 0.019 | 0.173 | |
| MLMBackbone=BERT-large, Masking Type=Contiguous pairs2023.05 | 10.42 | 104.12 | 4.582 | 2.463 | |
| MRFBackbone=BERT-large, Masking Type=Random pairs2023.05 | 10.57 | 19.54 | 0.723 | 0.193 | |
| HCBBackbone=BERT-large, Masking Type=Random pairs2023.05 | 10.71 | 20.7 | 0.797 | 0.215 | |
| AGBackbone=BERT-base, Masking Type=Random pairs2023.05 | 10.76 | 12.68 | 0.007 | 0.085 | |
| MLMBackbone=BERT-base, Masking Type=Random pairs2023.05 | 11.22 | 19.01 | 1.08 | 0.547 | |
| MRFLBackbone=BERT-large, Masking Type=Random pairs2023.05 | 11.52 | 76.23 | 0.449 | 0.276 | |
| MRFBackbone=BERT-base, Masking Type=Random pairs2023.05 | 12.3 | 21.65 | 0.658 | 0.179 | |
| HCBBackbone=BERT-base, Masking Type=Random pairs2023.05 | 12.51 | 22.62 | 0.593 | 0.168 | |
| MRFBackbone=BERT-large, Masking Type=Contiguous pairs2023.05 | 13.07 | 93.33 | 1.992 | 0.359 | |
| AGBackbone=BERT-base, Masking Type=Contiguous pairs2023.05 | 13.26 | 21.59 | 0.018 | 0.181 | |
| MRFLBackbone=BERT-base, Masking Type=Random pairs2023.05 | 13.39 | 71.44 | 0.433 | 0.267 | |
| MLMBackbone=BERT-base, Masking Type=Contiguous pairs2023.05 | 13.78 | 74.68 | 4.014 | 1.876 | |
| HCBBackbone=BERT-large, Masking Type=Contiguous pairs2023.05 | 14.43 | 458.25 | 2.563 | 0.552 | |
| MRFLBackbone=BERT-large, Masking Type=Contiguous pairs2023.05 | 15.43 | 8,536.92 | 1.47 | 0.543 | |
| HCBBackbone=BERT-base, Masking Type=Contiguous pairs2023.05 | 17.71 | 589.02 | 2.099 | 0.416 | |
| MRFBackbone=BERT-base, Masking Type=Contiguous pairs2023.05 | 18.35 | 126.05 | 1.967 | 0.366 | |
| MRFLBackbone=BERT-base, Masking Type=Contiguous pairs2023.05 | 23.45 | 13,568.17 | 1.543 | 0.607 |