Spatio-temporal Video Retrieval by Animated Sketching

Steven Verstockt, Olivier Janssens, Sofie Van Hoecke, Rik Van de Walle

2013

Abstract

In order to improve content-based searching in digital video, this paper proposes a novel intuitive querying method based on animated sketching. By sketching two or more frames of the desired scene, users can intuitively find the video sequences they are looking for. To find the best match for the user input, the proposed algorithm generates the edge histogram descriptors of both the sketches’ static background and its moving foreground objects. Based on these spatial descriptors, the set of videos is queried a first time to find video sequences in which similar background and foreground objects appear. This spatial filtering already results in sequences with similar scene characteristics as the sketch. However, further temporal analysis is needed to find the sequences in which the specific action, i.e. the sketched animation, occurs. This is done by matching the motion descriptors of the motion history images of the sketch and the video sequences. The sequences with the highest match are returned to the user. Experiments on a heterogeneous set of videos demonstrate that the system allows more intuitive video retrieval and yields appropriate query results, which match the sketches.

Paper Citation

in Harvard Style

Verstockt S., Janssens O., Hoecke S. and Walle R. (2013). Spatio-temporal Video Retrieval by Animated Sketching . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 723-728. DOI: 10.5220/0004341607230728

in Bibtex Style

@conference{visapp13,
author={Steven Verstockt and Olivier Janssens and Sofie Van Hoecke and Rik Van de Walle},
title={Spatio-temporal Video Retrieval by Animated Sketching},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={723-728},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004341607230728},
isbn={978-989-8565-47-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - Spatio-temporal Video Retrieval by Animated Sketching
SN - 978-989-8565-47-1
AU - Verstockt S.
AU - Janssens O.
AU - Hoecke S.
AU - Walle R.
PY - 2013
SP - 723
EP - 728
DO - 10.5220/0004341607230728