Client-side Mobile Visual Search

Andreas Hartl, Dieter Schmalstieg, Gerhard Reitmayr

2014

Abstract

Visual search systems present a simple way to obtain information about our surroundings, our location or an object of interest. Typically, mobile applications of visual search remotely connect to large-scale systems capable of dealing with millions of images. Querying such systems may induce considerable delays, which can severeley harm usability or even lead to complete rejection by the user. In this paper, we investigate an interim solution and system design using a local visual search system for embedded devices. We optimized a traditional visual search system to decrease runtime and also storage space in order to scale to thousands of training images on current off-the-shelf smartphones. We demonstrate practical applicability in a prototype for mobile visual search on the same target platform. Compared with the unmodified version of the pipeline we achieve up to a two-fold speed-up in runtime, save 85% of storage space and provide substantially increased recognition performance. In addition, we integrate the pipeline with a popular Augmented Reality SDK on Android devices and use it as a pre-selector for tracking datasets. This allows to instantly use a large number of tracking targets without requiring user intervention or costly server-side recognition.

Paper Citation

in Harvard Style

Hartl A., Schmalstieg D. and Reitmayr G. (2014). Client-side Mobile Visual Search . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-009-3, pages 125-132. DOI: 10.5220/0004672901250132

in Bibtex Style

@conference{visapp14,
author={Andreas Hartl and Dieter Schmalstieg and Gerhard Reitmayr},
title={Client-side Mobile Visual Search},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={125-132},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004672901250132},
isbn={978-989-758-009-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2014)
TI - Client-side Mobile Visual Search
SN - 978-989-758-009-3
AU - Hartl A.
AU - Schmalstieg D.
AU - Reitmayr G.
PY - 2014
SP - 125
EP - 132
DO - 10.5220/0004672901250132