# Validity Learning on Failures: Mitigating the Distribution Shift in Autonomous Vehicle Planning

Source: [Validity Learning on Failures: Mitigating the Distribution Shift in Autonomous Vehicle Planning](<https://www.sota2.com/research/paper/68fa74e41e209131cea64777>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-04T04:00:12.267Z

Authors: Fazel Arasteh, Mohammed Elmahgiubi, Behzad Khamidehi, Hamidreza Mirkhani, Weize Zhang, Cao Tongtong, Kasra Rezaee

Published: 2024-06-03T17:25:18.000Z

## Abstract

The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration of learning-based planning strategies. Among these approaches, Imitation Learning stands out due to its notable training efficiency. However, traditional Imitation Learning methodologies encounter challenges associated with the co-variate shift phenomenon. We propose Validity Learning on Failures, VL(on failure), as a remedy to address this issue. The essence of our method lies in deploying a pre-trained planner across diverse scenarios. Instances where the planner deviates from its immediate objectives, such as maintaining a safe distance from obstacles or adhering to traffic rules, are flagged as failures. The states corresponding to these failures are compiled into a new dataset, termed the failure dataset. Notably, the absence of expert annotations for this data precludes the applicability of standard imitation learning approaches. To facilitate learning from the closed-loop mistakes, we introduce the VL objective which aims to discern valid trajectories within the current environmental context. Experimental evaluations conducted on both reactive CARLA simulation and non-reactive log-replay simulations reveal substantial enhancements in closed-loop metrics such as \\textit{Score, Progress}, and Success Rate, underscoring the effectiveness of the proposed methodology. Further evaluations against the Bench2Drive benchmark demonstrate that VL(on failure) outperforms the state-of-the-art methods by a large margin.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Autonomous Driving on Bench2Drive 220 short segment scenarios](<https://www.sota2.com/research/sota/autonomous-driving-on-bench2drive-220-short-segment-scenarios.md>): Autonomous Driving; Bench2Drive 220 short segment scenarios; Driving Score: 77.3.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2406.01544>)

[PDF](<https://arxiv.org/pdf/2406.01544.pdf>)
