Self-Supervised Voxel-Level Representation Rediscovers Subcellular Structures in Volume Electron Microscopy

Journal article

Making sense of large volumes of biological imaging data without human annotation often relies on unsupervised representation learning. Although efforts have been made to representing cropped-out microscopy images of single cells and single molecules, a more robust and general model that effectively maps every voxel in a whole cell volume onto a latent space is still lacking. Here, we use variational auto-encoder and metric learning to obtain a voxel-level representation, and explore using it for unsupervised segmentation. To our knowledge we are the first to present self-supervised voxel-level representation and subsequent unsupervised segmentation results for a complete cell. We improve upon earlier work by proposing an innovative approach to separate latent space into a semantic subspace and a transformational subspace, and only use the semantic representation for segmentation. We show that in the learned semantic representation the major subcellular components are visually distinguishable and the semantic subspace is more transformation-invariant than another sample latent subspace of equal dimension. For unsupervised segmentation we found that our model manages to automatically rediscover and separate the major classes with errors demonstrating spatial patterns, and further dissect the class not specified by reference segmentation into areas with consistent textures. Our segmentation outperforms a baseline by a large margin.

Authors: Han, H; Dmitrieva, M; Sauer, A; Tam, KH; Rittscher, J

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IEEE
• Journal: Conference on Computer Vision and Pattern Recognition Workshops. IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Workshops
• Volume: 00
• Pages: 1873-1882
• Publication date: 2022-06-19
• DOI: 10.1109/cvprw56347.2022.00204
• ISSN: 2160-7508
• Pmid: 41971954
• Language: English
• Keywords: Artificial intelligence; Pattern recognition (psychology); Segmentation; Computer science; Voxel; Subspace topology; Representation (politics); Unsupervised learning; Pairwise comparison; Computer vision