Subject-verb agreement number prediction on Subject-Verb Agreement 2016 (test)
99.4Acc (0 attractors)Best Stack-RNN
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Best Stack-RNN2018.07 | 99.4 | 97.9 | 96.5 | 93.5 | 91.6 | 88 | 99.2 | |
| Best Attention2018.07 | 99.4 | 97.7 | 95.9 | 92.9 | 90.7 | 84.2 | 99.2 | |
| UT w/ ACTAdaptive Computation Time (ACT)=true2018.07 | 99.4 | 96.9 | 96.7 | 94.4 | 93.2 | 90.7 | 99.2 | |
| Best LSTM2018.07 | 99.3 | 97.2 | 95 | 92.2 | 90 | 84.2 | 99.1 | |
| Universal TransformerACT=false2018.07 | 99.3 | 97.1 | 96.9 | 94 | 92.1 | 89.2 | 99.2 | |
| Transformer2018.07 | 97.3 | 94.1 | 93.2 | 91.7 | 90.1 | 88.3 | 96.2 |