Joint optimisation for object class segmentation and dense stereo reconstruction

Conference item

The problems of dense stereo reconstruction and object class segmentation can both be formulated as Conditional Random Field based labelling problems, in which every pixel in the image is assigned a label corresponding to either its disparity, or an object class such as road or building. While these two problems are mutually informative, no attempt has been made to jointly optimise their labellings. In this work we provide a principled energy minimisation framework that unifies the two problems and demonstrate that, by resolving ambiguities in real world data, joint optimisation of the two problems substantially improves performance. To evaluate our method, we augment the street view Leuven data set, producing 70 hand labelled object class and disparity maps. We hope that the release of these annotations will stimulate further work in the challenging domain of street-view analysis.

Authors: Ladický, L; Sturgess, P; Russell, C; Sengupta, S; Bastanlar, Y

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: British Machine Vision Association
• Host title: Proceedings of the 21st British Machine Vision Conference (BMVC 2010)
• Pages: 104.1-104.11
• Publication date: 2010-08-31
• Event title: 21st British Machine Vision Conference (BMVC 2010)
• Event location: Aberystwyth, Wales
• Event website: https://bmva-archive.org.uk/bmvc/2010/index.html
• Event start date: 2010-08-31
• Event end date: 2010-09-03
• DOI: 10.5244/c.24.104
• ISBN: 1901725405
• Language: English