# The efficacy of Neural Planning Metrics: A meta-analysis of PKL on nuScenes

Source: [The efficacy of Neural Planning Metrics: A meta-analysis of PKL on nuScenes](<https://www.sota2.com/research/paper/68fa6a551e209131cea27772>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:56:48.730Z

Authors: Yiluan Guo, Holger Caesar, Oscar Beijbom, Jonah Philion, Sanja Fidler

Published: 2020-10-19T09:32:48.000Z

## Abstract

A high-performing object detection system plays a crucial role in autonomous driving (AD). The performance, typically evaluated in terms of mean Average Precision, does not take into account orientation and distance of the actors in the scene, which are important for the safe AD. It also ignores environmental context. Recently, Philion et al. proposed a neural planning metric (PKL), based on the KL divergence of a planner's trajectory and the groundtruth route, to accommodate these requirements. In this paper, we use this neural planning metric to score all submissions of the nuScenes detection challenge and analyze the results. We find that while somewhat correlated with mAP, the PKL metric shows different behavior to increased traffic density, ego velocity, road curvature and intersections. Finally, we propose ideas to extend the neural planning metric.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2010.09350>)

[PDF](<https://arxiv.org/pdf/2010.09350.pdf>)
