Instruction Following on ALCHEMY
85.48AccuracyT5 + LEXSYM
Evaluation results
| Method | Links | |
|---|---|---|
| T5 + LEXSYMPre-training=Language Pre-training, Augmentation=LEXSYM2022.01 | 85.48 | |
| T5Pre-training=Language Pre-training2022.01 | 84.95 | |
| LSTM + LEXSYMPre-training=None, Augmentation=LEXSYM2022.01 | 45.85 | |
| LSTMPre-training=None2022.01 | 41.72 | |
| LSTM + SubstitutePre-training=None, Augmentation=Substitute2022.01 | 40.52 | |
| LexLSTMPre-training=None2022.01 | 36.8 |