Scene classification via pLSA

Conference item

Given a set of images of scenes containing multiple object categories (e.g. grass, roads, buildings) our objective is to discover these objects in each image in an unsupervised manner, and to use this object distribution to perform scene classification. We achieve this discovery using probabilistic Latent Semantic Analysis (pLSA), a generative model from the statistical text literature, here applied to a bag of visual words representation for each image. The scene classification on the object distribution is carried out by a k-nearest neighbour classifier.
We investigate the classification performance under changes in the visual vocabulary and number of latent topics learnt, and develop a novel vocabulary using colour SIFT descriptors. Classification performance is compared to the supervised approaches of Vogel & Schiele [19] and Oliva & Torralba [11], and the semi-supervised approach of Fei Fei & Perona [3] using their own datasets and testing protocols. In all cases the combination of (unsupervised) pLSA followed by (supervised) nearest neighbour classification achieves superior results. We show applications of this method to image retrieval with relevance feedback and to scene classification in videos.

Authors: Bosch, A; Zisserman, A; Muñoz, X

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Springer
• Host title: Computer Vision — ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7-13, 2006, Proceedings, Part IV
• Pages: 517-530
• Series: Lecture Notes in Computer Science
• Series number: 3954
• Place of publication: Heidelberg
• Publication date: 2006-07-25
• Event title: 9th European Conference on Computer Vision (ECCV 2006)
• Event location: Graz, Austria
• Event start date: 2006-05-07
• Event end date: 2006-05-13
• DOI: 10.1007/11744085_40
• EISSN: 1611-3349
• ISSN: 0302-9743
• EISBN: 9783540338390
• ISBN-10: 3540338381
• ISBN-13: 9783540338383
• Language: English