Natural Language Inference on MultiNLI mismatched (test)
81.4AccuracyLM-Transformer
Evaluation Results
| Method | Links | |
|---|---|---|
| LM-Transformerensemble=false2018.05 | 81.4 | |
| DRCN+ELMoensemble=true, embedding=ELMo2018.05 | 81.4 | |
| DRCNensemble=true2018.05 | 79.5 | |
| CAFEensemble=true2018.05 | 79 | |
| DIINExtra SNLI training set=true2017.11 | 78.8 | |
| DIINEnsemble=true2017.09 | 78.7 | |
| DIINensemble=true2018.05 | 78.7 | |
| DRCNensemble=false2018.05 | 78.4 | |
| CAFEensemble=false2018.05 | 77.9 | |
| CAFE2017.11 | 77.9 | |
| DIINEnsemble=false2017.09 | 77.8 | |
| DIINensemble=false2018.05 | 77.8 | |
| KIM2017.11 | 76.4 | |
| ESIM2017.11 | 75.8 | |
| Gated-Att BiLSTMEnsemble=true2017.09 | 74.9 | |
| BiLSTM with generalized pooling# Params=18M2018.09 | 74 | |
| ESIM GloVeAuxiliary Information=GloVe vectors2017.06 | 73.92 | |
| 2-layer Bi-CAS-LSTM# Params=6.8M2018.09 | 73.7 | |
| Deep Gated Attn. BiLSTM encodersSNLI Mix=false, Parameter count=11.6m2017.12 | 73.6 | |
| Gated-Att BiLSTMEnsemble=false2017.09 | 73.6 | |
| Shortcut-Stacked encoderEnsemble=false2017.09 | 73.6 | |
| Deep Gated Attn. BiLSTM encoders2018.08 | 73.6 | |
| Shortcut stacked BiLSTM# Params=140M, Additional training data=SNLI dataset2018.09 | 73.6 | |
| BiLSTM with gated pooling# Params=12M2018.09 | 73.6 | |
| Gated BiLSTM2017.11 | 73.6 | |
| SS BILSTM2017.11 | 73.6 | |
| Shortcut-Stacked BiLSTM encodersSNLI Mix=true, Parameter count=140.2m2017.12 | 73.5 | |
| Shortcut-Stacked BiLSTM2018.08 | 73.5 | |
| 3-layer Bi-CAS-LSTM# Params=8.6M2018.09 | 73.4 | |
| 2-layer CAS-LSTM# Params=2.9M2018.09 | 73.3 | |
| 3-layer CAS-LSTM# Params=4.8M2018.09 | 73.1 | |
| HBMPdimensions=600D2018.08 | 73 | |
| Distance-based Self-Attention NetworkSNLI Mix=false, Parameter count=4.7m2017.12 | 72.9 | |
| InnerAttEnsemble=true2017.09 | 72.8 | |
| BiLSTM + Inner-attentionSNLI Mix=true2017.12 | 72.1 | |
| InnerAttEnsemble=false2017.09 | 72.1 | |
| ESIMEnsemble=false2017.09 | 72.1 | |
| ESIMensemble=false2018.05 | 72.1 | |
| BiLSTM + Inner-attention2018.08 | 72.1 | |
| Directional Self-Attention NetworkSNLI Mix=false, Parameter count=2.4m2017.12 | 71.4 | |
| DiSAN2017.11 | 71.4 | |
| BiLSTM + enhanced embedding + max poolingSNLI Mix=false2017.12 | 70.8 | |
| BiLSTM + enh embed + max pooling2018.08 | 70.8 | |
| ESIM dictionaryAuxiliary Information=dictionary definitions2017.06 | 70.7 | |
| ESIM spellingAuxiliary Information=spelling2017.06 | 69.76 | |
| ESIM baselineAuxiliary Information=none2017.06 | 68.57 | |
| Cha-level Intra-attention BiLSTM encodersSNLI Mix=true2017.12 | 68.2 | |
| BiLSTMEnsemble=false2017.09 | 67.6 | |
| BiLSTMSNLI Mix=true2017.12 | 67.1 | |
| BiLSTM2018.08 | 67.1 | |
| BiLSTM# Params=null2018.09 | 66.9 | |
| BILSTM2017.11 | 66.9 | |
| CBOWSNLI Mix=true2017.12 | 64.6 | |
| CBOW2018.08 | 64.6 | |
| CBOW# Params=null2018.09 | 64.5 | |
| CBOW2017.11 | 64.5 |