Resource allocation in large-scale wireless control systems with graph neural networks

Conference item

Modern control systems routinely employ wireless networks to exchange information between a large number of plants, actuators and sensors. While wireless networks are defined by random, rapidly changing conditions that challenge common control design assumptions, properly allocating communication resources helps to maintain operation reliable. Designing resource allocation policies is usually challenging and requires explicit knowledge of the system and communication dynamics, but recent works have successfully explored deep reinforcement learning techniques to find optimal model-free resource allocation policies. Deep reinforcement learning algorithms do not necessarily scale well, however, which limits the immediate generalization of those approaches to large-scale wireless control systems. In this paper we discuss the use of reinforcement learning and graph neural networks (GNNs) to design model-free, scalable resource allocation policies. On the one hand, GNNs generalize the spatial-temporal convolutions present in convolutional neural networks (CNNs) to data defined over arbitrary graphs. In doing so, GNNs manage to exploit local regular structure encoded in graphs to reduce the dimensionality of the learning space. The architecture of the wireless network, on the other, defines an underlying communication graph that can be used as basis for a GNN model. Numerical experiments show the learned policies outperform baseline resource allocation solutions.

Authors: Lima, V; Eisen, M; Gatsis, K; Ribeiro, A

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: International Federation of Automatic Control
• Journal: IFAC-PapersOnLine
• Volume: 53
• Issue: 2
• Pages: 2634-2641
• Publication date: 2021-04-14
• Acceptance date: 2020-05-11
• Event title: 21st IFAC World Congress (IFAC 2020)
• Event location: Berlin, Germany
• Event website: https://www.ifac2020.org/
• Event start date: 2020-07-12
• Event end date: 2020-07-17
• DOI: 10.1016/j.ifacol.2020.12.378
• ISSN: 1474-6670
• Language: English
• Keywords: control over networks; resource allocation; neural networks; graph neural networks; FFR; reinforcement learning control