# Topology-Aware Graph Reinforcement Learning for Energy Storage Systems Optimal Dispatch in Distribution Networks

Source: [Topology-Aware Graph Reinforcement Learning for Energy Storage Systems Optimal Dispatch in Distribution Networks](<https://www.sota2.com/research/paper/69ca036a0636e5bf4afc925d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-31T05:00:04.048Z

Authors: Shuyi Gao, Stavros Orfanoudakis, Shengren Hou, Peter Palensky, Pedro P. Vergara

Published: 2026-03-27T10:32:18.000Z

## Abstract

Optimal dispatch of energy storage systems (ESSs) in distribution networks involves jointly improving operating economy and voltage security under time-varying conditions and possible topology changes. To support fast online decision making, we develop a topology-aware Reinforcement Learning architecture based on Twin Delayed Deep Deterministic Policy Gradient (TD3), which integrates graph neural networks (GNNs) as graph feature encoders for ESS dispatch. We conduct a systematic investigation of three GNN variants: graph convolutional networks (GCNs), topology adaptive graph convolutional networks (TAGConv), and graph attention networks (GATs) on the 34-bus and 69-bus systems, and evaluate robustness under multiple topology reconfiguration cases as well as cross-system transfer between networks with different system sizes. Results show that GNN-based controllers consistently reduce the number and magnitude of voltage violations, with clearer benefits on the 69-bus system and under reconfiguration; on the 69-bus system, TD3-GCN and TD3-TAGConv also achieve lower saved cost relative to the NLP benchmark than the NN baseline. We also highlight that transfer gains are case-dependent, and zero-shot transfer between fundamentally different systems results in notable performance degradation and increased voltage magnitude violations. This work is available at: https://github.com/ShuyiGao/GNNs\_RL\_ESSs and https://github.com/distributionnetworksTUDelft/GNNs\_RL\_ESSs.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Economic Dispatch and Voltage Regulation on 69-bus (test)](<https://www.sota2.com/research/sota/economic-dispatch-and-voltage-regulation-on-69-bus-test.md>): Economic Dispatch and Voltage Regulation; 69-bus (test); Execution Time (s): 0.2351.

- [Power System Dispatch on 34 buses (test)](<https://www.sota2.com/research/sota/power-system-dispatch-on-34-buses-test.md>): Power System Dispatch; 34 buses (test); Saved Costs: 195.28.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2603.26264>)

[PDF](<https://arxiv.org/pdf/2603.26264.pdf>)
