Navigation Instruction Generation on Partially seen routes 200 instances (test)
53.5Lengthreference
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| referenceType=Human Reference2020.12 | 53.5 | — | 2.76 | 0.728 | 85.5 | 0.878 | |
| rule basedType=Heuristic-based2020.12 | 53.1 | 0.71 | 12.44 | 0.405 | 46 | 0.455 | |
| seq2seqArchitecture=Transformer2020.12 | 52.9 | 13.12 | 1.95 | 0.139 | 16 | 0.206 | |
| graph2textPre-training=false2020.12 | 52.6 | 18.6 | 2.41 | 0.475 | 54 | 0.676 | |
| g2t+pretrainPre-training=true2020.12 | 52.5 | 18.81 | 2.44 | 0.471 | 54 | 0.537 |