# Agricultural Vision-and-Language Navigation on A2A low-complexity subtask 2 Source: [Agricultural Vision-and-Language Navigation on A2A low-complexity subtask 2]() Collection index: [llms.txt]() Data updated: 2026-03-27T13:58:03.442Z Evaluation of Agricultural Vision-and-Language Navigation performance on the A2A low-complexity subtask 2 dataset, measured by Success Rate (SR), Navigation Error (NE), TUp, and TUc. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Agricultural Vision-and-Language Navigation | | Dataset (including any stated split) | A2A low-complexity subtask 2 | | Metric | Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 19 of 19 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: PERCENT. - [Navigation Error](): Lower is better; unit: OTHER. - [TUp](): Higher is better; unit: PERCENT. - [TUc](): Higher is better; unit: PERCENT. - [BERTScore](): Higher is better; unit: PERCENT. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | Human | 93 | Not recorded | 693115d1d6b0dd3342933d50 | | Human | 93 | Not recorded | 68fa7b601e209131cea8801e | | T-araVLNg | 80 | Not recorded | 68fa7b601e209131cea8801e | | T-araVLNd | 70 | Not recorded | 68fa7b601e209131cea8801e | | T-araVLNc | 66 | Not recorded | 68fa7b601e209131cea8801e | | AgriVLN | 58 | Not recorded | 68fa7b601e209131cea8801e | | SIA-VLN | 52 | Not recorded | 68fa7b601e209131cea8801e | | NavGPT | 51 | Not recorded | 68fa7b601e209131cea8801e | | MDE-AgriVLN | 44 | Not recorded | 693115d1d6b0dd3342933d50 | | MDE-AgriVLN | 41 | Not recorded | 693115d1d6b0dd3342933d50 | | DILLM-VLN | 41 | Not recorded | 68fa7b601e209131cea8801e | | MDE-AgriVLN | 40 | Not recorded | 693115d1d6b0dd3342933d50 | | DILLM-VLN | 31 | Not recorded | 693115d1d6b0dd3342933d50 | | AgriVLN | 30 | Not recorded | 693115d1d6b0dd3342933d50 | | SIA-VLN | 26 | Not recorded | 693115d1d6b0dd3342933d50 | | Random | 13 | Not recorded | 693115d1d6b0dd3342933d50 | | Random | 13 | Not recorded | 68fa7b601e209131cea8801e | | Fixed | 0 | Not recorded | 693115d1d6b0dd3342933d50 | | Fixed | 0 | Not recorded | 68fa7b601e209131cea8801e | ### Human Success Rate: 93. Result ID: 6999f54a5698665ec4766058. [Reporting paper]() Recorded evaluation configuration: {"MDE Representation":"-"}. This record does not assert independent reproduction. ### Human Success Rate: 93. Result ID: 69c68cd447f34ce924b0c3b9. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### T-araVLNg Success Rate: 80. Result ID: 69c68cd447f34ce924b0c3b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM for Instruction Translator":"GPT-4.1"}. This record does not assert independent reproduction. ### T-araVLNd Success Rate: 70. Result ID: 69c68cd447f34ce924b0c3b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM for Instruction Translator":"DeepSeek-R1"}. This record does not assert independent reproduction. ### T-araVLNc Success Rate: 66. Result ID: 69c68cd447f34ce924b0c3b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM for Instruction Translator":"Claude-3.7"}. This record does not assert independent reproduction. ### AgriVLN Success Rate: 58. Result ID: 69c68cd447f34ce924b0c3b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SIA-VLN Success Rate: 52. Result ID: 69c68cd447f34ce924b0c3b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### NavGPT Success Rate: 51. Result ID: 69c68cd447f34ce924b0c3b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MDE-AgriVLN Success Rate: 44. Result ID: 6999f54a5698665ec4766055. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"MDE Representation":"Depth Matrix"}. This record does not assert independent reproduction. ### MDE-AgriVLN Success Rate: 41. Result ID: 6999f54a5698665ec4766057. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"MDE Representation":"Hybrid"}. This record does not assert independent reproduction. ### DILLM-VLN Success Rate: 41. Result ID: 69c68cd447f34ce924b0c3b4. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MDE-AgriVLN Success Rate: 40. Result ID: 6999f54a5698665ec4766056. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"MDE Representation":"Depth Map"}. This record does not assert independent reproduction. ### DILLM-VLN Success Rate: 31. Result ID: 6999f54a5698665ec4766053. [Reporting paper]() Recorded evaluation configuration: {"MDE Representation":"-"}. This record does not assert independent reproduction. ### AgriVLN Success Rate: 30. Result ID: 6999f54a5698665ec4766054. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"MDE Representation":"-"}. This record does not assert independent reproduction. ### SIA-VLN Success Rate: 26. Result ID: 6999f54a5698665ec4766052. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"MDE Representation":"-"}. This record does not assert independent reproduction. ### Random Success Rate: 13. Result ID: 6999f54a5698665ec4766050. [Reporting paper]() Recorded evaluation configuration: {"MDE Representation":"-"}. This record does not assert independent reproduction. ### Random Success Rate: 13. Result ID: 69c68cd447f34ce924b0c3b0. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Fixed Success Rate: 0. Result ID: 6999f54a5698665ec4766051. [Reporting paper]() Recorded evaluation configuration: {"MDE Representation":"-"}. This record does not assert independent reproduction. ### Fixed Success Rate: 0. Result ID: 69c68cd447f34ce924b0c3b1. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.