Navigation Instruction Generation on Unseen Routes 200 instances (test)
50.3Length (Len.)g2t+pretrain
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| g2t+pretrainpretraining=true2020.12 | 50.3 | 15.64 | 2.33 | 0.387 | 42.9 | 53 | |
| graph2textpretraining=false2020.12 | 50.5 | 14.07 | 1.74 | 0.344 | 40 | 53.4 | |
| seq2seqarchitecture=Transformer2020.12 | 51.8 | 11.12 | 1.58 | 0.074 | 10 | 13.7 | |
| rule basedtype=heuristic system2020.12 | 52.3 | 0.67 | 10.96 | 0.472 | 52.5 | 51.2 | |
| referencetype=human reference2020.12 | 57.5 | — | 2.68 | 0.725 | 82.4 | 79.1 |