Self-supervised multi-task representation learning for sequential medical images

Conference item

Self-supervised representation learning has achieved promising results for downstream visual tasks in natural images. However, its use in the medical domain, where there is an underlying anatomical structural similarity, remains underexplored. To address this shortcoming, we propose a self-supervised multi-task representation learning framework for sequential 2D medical images, which explicitly aims to exploit the underlying structures via multiple pretext tasks. Unlike the current state-of-the-art methods, which are designed to only pre-train the encoder for instance discrimination tasks, the proposed framework can pre-train the encoder and the decoder at the same time for dense prediction tasks. We evaluate the representations extracted by the proposed framework on two public whole heart segmentation datasets from different domains. The experimental results show that our proposed framework outperforms MoCo V2, a strong representation learning baseline. Given only a small amount of labeled data, the segmentation networks pre-trained by the proposed framework on unlabeled data can achieve better results than their counterparts trained by standard supervised approaches.

Authors: Dong, N; Kampffmeyer, M; Voiculescu, I

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Springer
• Host title: Machine Learning and Knowledge Discovery in Databases. Research Track. ECML PKDD 2021
• Volume: 12977
• Pages: 779-794
• Series: Lectures Notes in Computer Science
• Publication date: 2021-09-11
• Acceptance date: 2021-06-18
• Event title: European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases 2021
• Event location: Virtual event
• Event website: https://2021.ecmlpkdd.org/
• Event start date: 2021-09-13
• Event end date: 2021-09-17
• DOI: 10.1007/978-3-030-86523-8_47
• ISSN: 0302-9743
• EISBN: 978-3-030-86523-8
• ISBN: 978-3-030-86522-1
• Language: English
• Keywords: medical image segmentation; multi-task learning; self-supervised learning; FFR