Human-centered Region Selection and Weighting for Image Retrieval

Jean Martinet

2013

Abstract

We present an application of gaze tracking to image and video indexing, in the form of a model for selecting and weighting Regions of Interest (RoIs). Image/video indexing refers to the process of creating a synthetic representation of the media, for instance for retrieval purposes. It usually consists in labeling the media with semantic keywords describing its content. When automatized, this process is based on the analysis of visual features, which can be extracted either from the whole image or keyframe, or locally from regions. Since most of the times the whole image is not relevant for indexing (e.g. large flat regions with no specific semantic interpretation, blur regions, background regions that may not be relevant for retrieval purposes, and that should be filtered out), it would be preferable to concentrate the labeling process on specific RoIs that are considered representative of the scene, like the main subjects. The objective of the work presented here is to take advantage of natural human gaze information in order to define a human-centered Region of Interest selection and weighting technique in the context of media retrieval.

Paper Citation

in Harvard Style

Martinet J. (2013). Human-centered Region Selection and Weighting for Image Retrieval . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 729-734. DOI: 10.5220/0004348707290734

in Bibtex Style

@conference{visapp13,
author={Jean Martinet},
title={Human-centered Region Selection and Weighting for Image Retrieval},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={729-734},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004348707290734},
isbn={978-989-8565-47-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - Human-centered Region Selection and Weighting for Image Retrieval
SN - 978-989-8565-47-1
AU - Martinet J.
PY - 2013
SP - 729
EP - 734
DO - 10.5220/0004348707290734