Lost in quantization: improving particular object retrieval in large scale image databases

Conference item

The state of the art in visual object retrieval from large databases is achieved by systems that are inspired by text retrieval. A key component of these approaches is that local regions of images are characterized using high-dimensional descriptors which are then mapped to ldquovisual wordsrdquo selected from a discrete vocabulary.This paper explores techniques to map each visual region to a weighted set of words, allowing the inclusion of features which were lost in the quantization stage of previous systems. The set of visual words is obtained by selecting words based on proximity in descriptor space. We describe how this representation may be incorporated into a standard tf-idf architecture, and how spatial verification is modified in the case of this soft-assignment. We evaluate our method on the standard Oxford Buildings dataset, and introduce a new dataset for evaluation. Our results exceed the current state of the art retrieval performance on these datasets, particularly on queries with poor initial recall where techniques like query expansion suffer. Overall we show that soft-assignment is always beneficial for retrieval with large vocabularies, at a cost of increased storage requirements for the index.

Authors: Philbin, J; Chum, O; Isard, M; Sivic, J; Zisserman, A

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IEEE
• Host title: 2008 IEEE Conference on Computer Vision and Pattern Recognition
• Publication date: 2008-08-05
• Event title: 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008)
• Event location: Anchorage, Alaska, USA
• Event website: https://www.computer.org/csdl/proceedings/cvpr/2008/12OmNA0MYZb
• Event start date: 2008-06-23
• Event end date: 2008-06-28
• DOI: 10.1109/cvpr.2008.4587635
• ISSN: 1063-6919
• ISBN: 9781424422425
• Language: English
• Keywords: large-scale systems; visual databases; architecture; image retrieval; buildings; SBTMR; image databases; information retrieval; costs; vocabulary; quantization