Modelling and unsupervised learning of symmetric deformable object categories

Conference item

We propose a new approach to model and learn, without manual supervision, the symmetries of natural objects, such as faces or flowers, given only images as input. It is well known that objects that have a symmetric structure do not usually result in symmetric images due to articulation and perspective effects. This is often tackled by seeking the intrinsic symmetries of the underlying 3D shape, which is very difficult to do when the latter cannot be recovered reliably from data. We show that, if only raw images are given, it is possible to look instead for symmetries in the space of object deformations. We can then learn symmetries from an unstructured collection of images of the object as an extension of the recently-introduced object frame representation, modified so that object symmetries reduce to the obvious symmetry groups in the normalized space. We also show that our formulation provides an explanation of the ambiguities that arise in recovering the pose of symmetric objects from their shape or images and we provide a way of discounting such ambiguities in learning.

Authors: Thewlis, J; Bilen, H; Vedaldi, A

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Neural Information Processing Systems
• Host title: Advances in Neural Information Processing Systems 31 (NIPS 2018)
• Journal: Neural Information Processing Systems (NIPS), 2018
• Acceptance date: 2018-09-05