Learning to learn graph topologies

Conference item

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the problem can be formulated as a regularised convex optimisation over a positive semidefinite cone and solved by iterative algorithms. Classic methods require an explicit convex function to reflect generic topological priors, e.g. the ℓ1 penalty for enforcing sparsity, which limits the flexibility and expressiveness in learning rich topological structures. We propose to learn a mapping from node data to the graph structure based on the idea of learning to optimise (L2O). Specifically, our model first unrolls an iterative primal-dual splitting algorithm into a neural network. The key structural proximal projection is replaced with a variational autoencoder that refines the estimated graph with enhanced topological properties. The model is trained in an end-to-end fashion with pairs of node data and graph samples. Experiments on both synthetic and real-world data demonstrate that our model is more efficient than classic iterative algorithms in learning a graph with specific topological properties.

Authors: Pu, X; Cao, T; Zhang, X; Dong, X; Chen, S

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Neural Information Processing Systems Foundation
• Host title: Proceedings of Advances in Neural Information Processing Systems 34 (NeurIPS 2021)
• Pages: 4249-4262
• Publication date: 2021-01-01
• Event title: Advances in Neural Information Processing Systems 34 (NeurIPS 2021)
• Event location: Virtual event
• Event website: https://nips.cc/Conferences/2021
• Event start date: 2021-12-06
• Event end date: 2021-12-14
• ISBN: 9781713845393
• Language: English
• Keywords: FFR