Combined generation of electrocardiogram and cardiac anatomy models using multi-modal variational autoencoders

Conference item

Understanding population-wide variability of the human heart is crucial to detect abnormalities and improve the assessment of both cardiac anatomy and function. While many computational modeling approaches have been developed to capture this variability separately for either cardiac anatomy or physiology, their complex interconnections have rarely been explored together. In this work, we propose a novel multi-modal variational autoencoder (VAE) capable of processing combined physiology and bitemporal anatomy information in the form of electrocardiograms (ECG) and 3D biventricular point clouds. Our method achieves high reconstruction accuracy on a UK Biobank dataset with Chamfer distances between predicted and input anatomies below the underlying image resolution and the ECG reconstructions outperforming a state-of-the-art benchmark approach specialized in ECG generation. We also evaluate its generative ability and find comparable populations of generated and gold standard anatomies, ECGs, and combined anatomy-ECG data in terms of common clinical metrics and maximum mean discrepancies.

Authors: Beetz, M; Banerjee, A; Sang, Y; Grau, V

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IEEE
• Host title: Proceedings of the 2022 IEEE international symposium on biomedical imaging (IEEE ISBI 2022)
• Pages: 1-4
• Publication date: 2022-04-26
• Acceptance date: 2022-03-01
• Event title: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)
• Event location: Kolkata, India
• Event website: https://biomedicalimaging.org/2022/
• Event start date: 2022-03-28
• Event end date: 2022-03-31
• DOI: 10.1109/ISBI52829.2022.9761590
• EISSN: 1945-8452
• ISSN: 1945-7928
• ISBN: 9781665429238
• Language: English
• Keywords: 3D cardiac anatomy generation; ECG synthesis; multi-modal VAE; geometric deep learning; combined anatomy and electrophysiology modeling; FFR