Natural Language Inference on HANS (val)
84.3AccuracyConfReg
Evaluation results
| Method | Links | |
|---|---|---|
| ConfRegSelection Strategy=ID, Penalty=-2022.06 | 84.3 | |
| EIIL-PGISelection Strategy=ID, Penalty=PGI2022.06 | 84.17 | |
| ERMSelection Strategy=ID, Penalty=-2022.06 | 84.12 | |
| ERMSelection Strategy=Oracle, Penalty=-2022.06 | 84.12 | |
| EIIL-RExSelection Strategy=ID, Penalty=REx2022.06 | 84.1 | |
| EIIL-IRMSelection Strategy=ID, Penalty=IRM2022.06 | 84.01 | |
| EIIL-IRMSelection Strategy=TEV, Penalty=IRM2022.06 | 84.01 | |
| EIIL-RExSelection Strategy=TEV, Penalty=REx2022.06 | 84 | |
| EIIL-PGISelection Strategy=TEV, Penalty=PGI2022.06 | 83.94 | |
| EIIL-RExSelection Strategy=Oracle, Penalty=REx2022.06 | 83.91 | |
| EIIL-IRMSelection Strategy=Oracle, Penalty=IRM2022.06 | 83.82 | |
| EIIL-PGISelection Strategy=Oracle, Penalty=PGI2022.06 | 83.78 | |
| EIIL-cMMDSelection Strategy=ID, Penalty=cMMD2022.06 | 83.56 | |
| EIIL-cMMDSelection Strategy=TEV, Penalty=cMMD2022.06 | 83.38 | |
| EIIL-cMMDSelection Strategy=Oracle, Penalty=cMMD2022.06 | 83.22 | |
| PoESelection Strategy=ID, Penalty=-2022.06 | 82.8 | |
| SCILL-PGISelection Strategy=ID, Penalty=PGI2022.06 | 82.79 | |
| SCILL-PGISelection Strategy=TEV, Penalty=PGI2022.06 | 82.79 | |
| SCILL-IRMSelection Strategy=ID, Penalty=IRM2022.06 | 82.75 | |
| SCILL-cMMDSelection Strategy=ID, Penalty=cMMD2022.06 | 82.74 | |
| SCILL-RExSelection Strategy=ID, Penalty=REx2022.06 | 82.68 | |
| SCILL-IRMSelection Strategy=TEV, Penalty=IRM2022.06 | 82.67 | |
| SCILL-cMMDSelection Strategy=TEV, Penalty=cMMD2022.06 | 82.61 | |
| SCILL-RExSelection Strategy=Oracle, Penalty=REx2022.06 | 82.59 | |
| SCILL-IRMSelection Strategy=Oracle, Penalty=IRM2022.06 | 82.56 | |
| SCILL-RExSelection Strategy=TEV, Penalty=REx2022.06 | 82.56 | |
| SCILL-cMMDSelection Strategy=Oracle, Penalty=cMMD2022.06 | 82.39 | |
| SCILL-PGISelection Strategy=Oracle, Penalty=PGI2022.06 | 81.69 |