# Expert Level control of Ramp Metering based on Multi-task Deep Reinforcement Learning

Source: [Expert Level control of Ramp Metering based on Multi-task Deep Reinforcement Learning](<https://www.sota2.com/research/paper/68fa63181e209131ce9fca8e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T05:52:51.467Z

Authors: Francois Belletti, Daniel Haziza, Gabriel Gomes, Alexandre M. Bayen

Published: 2017-01-30T21:27:14.000Z

## Abstract

This article shows how the recent breakthroughs in Reinforcement Learning (RL) that have enabled robots to learn to play arcade video games, walk or assemble colored bricks, can be used to perform other tasks that are currently at the core of engineering cyberphysical systems. We present the first use of RL for the control of systems modeled by discretized non-linear Partial Differential Equations (PDEs) and devise a novel algorithm to use non-parametric control techniques for large multi-agent systems. We show how neural network based RL enables the control of discretized PDEs whose parameters are unknown, random, and time-varying. We introduce an algorithm of Mutual Weight Regularization (MWR) which alleviates the curse of dimensionality of multi-agent control schemes by sharing experience between agents while giving each agent the opportunity to specialize its action policy so as to tailor it to the local parameters of the part of the system it is located in.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Traffic Management (Acceleration Guidance) on Single-Lane Ring](<https://www.sota2.com/research/sota/traffic-management-acceleration-guidance-on-single-lane-ring.md>): Traffic Management (Acceleration Guidance); Single-Lane Ring; Average Speed (m/s): 3.94.

- [Traffic Management (Acceleration Guidance) on Highway Ramp](<https://www.sota2.com/research/sota/traffic-management-acceleration-guidance-on-highway-ramp.md>): Traffic Management (Acceleration Guidance); Highway Ramp; Average Speed (m/s): 4.53.

- [Traffic Management (Speed Guidance) on Single-Lane Ring](<https://www.sota2.com/research/sota/traffic-management-speed-guidance-on-single-lane-ring.md>): Traffic Management (Speed Guidance); Single-Lane Ring; Average Speed (m/s): 4.28.

- [Traffic Management (Speed Guidance) on Highway Ramp](<https://www.sota2.com/research/sota/traffic-management-speed-guidance-on-highway-ramp.md>): Traffic Management (Speed Guidance); Highway Ramp; Average Speed (m/s): 4.42.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1701.08832>)

[PDF](<https://arxiv.org/pdf/1701.08832.pdf>)