Subtask Completion on ALFRED
0.53Avg Completion Rate(SL)³
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| (SL)³Supervision level=100%2021.10 | 0.53 | 0.68 | 0.82 | 0.75 | 0.5 | 0.45 | 0.55 | 0.32 | 0.15 | |
| (SL)³Supervision level=10%2021.10 | 0.5 | 0.56 | 0.75 | 0.74 | 0.5 | 0.48 | 0.54 | 0.32 | 0.13 | |
| seq2seq2seqSupervision level=100%2021.10 | 0.39 | 0.15 | 0.69 | 0.58 | 0.29 | 0.42 | 0.5 | 0.32 | 0.15 | |
| seq2seqSupervision level=100%2021.10 | 0.25 | 0.16 | 0.33 | 0.64 | 0.2 | 0.15 | 0.25 | 0.13 | 0.14 |