Sequential Instruction Understanding on SCONE 1.0 (test)
74.5Score (Sce)FLOWQA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FLOWQAflow_mechanism=enabled2018.10 | 74.5 | 72.3 | 76.4 | |
| Fried et al. (2018)2018.10 | 72.7 | 69.6 | 72 | |
| Suhr & Artzi (2018)2018.10 | 66.4 | 60.1 | 62.3 | |
| FLOWQAflow_mechanism=disabled2018.10 | 58.2 | 67.9 | 74.1 | |
| Guu et al. (2017)2018.10 | 46.2 | 37.1 | 52.9 | |
| Long et al. (2016)2018.10 | 14.7 | 27.6 | 52.3 |