Sequential instruction understanding on SCONE (dev)
64.1Sce. ScoreFLOWQA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FLOWQAFLOW=true2018.10 | 64.1 | 74.4 | 84.1 | |
| Suhr & Artzi2018.10 | 56.1 | 60.3 | 71.8 | |
| FLOWQAFLOW=false2018.10 | 53 | 67.8 | 82 |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| FLOWQAFLOW=true2018.10 | 64.1 | 74.4 | 84.1 | |
| Suhr & Artzi2018.10 | 56.1 | 60.3 | 71.8 | |
| FLOWQAFLOW=false2018.10 | 53 | 67.8 | 82 |