Photo-based Multimedia Applications using Image Features Detection

Rui Nóbrega, Nuno Correia

2013

Abstract

This paper proposes a framework for the creation of interactive multimedia applications that take advantage of detected features from user-captured photos. The goal is to create games, architectural and space planning applications that interact with visual elements in the images such as walls, floors and empty spaces. The framework takes advantage of a semi-automatic algorithm to detect scene elements and camera parameters. Using the detected features, virtual objects can be inserted in the scene. In this paper several example applications are presented and discussed, and the reliability of the detection algorithm is compared with other systems. The presented solution analyses the photos using graph-cuts for segmentation, vanishing point detection and line analysis to detect the scene elements. The main advantage of the proposed framework is the semi-automatic creation of the tri-dimensional model to be used in mixed reality applications. This enables scenarios where the user can be responsible for the input scene without much prior knowledge or experience. The current implemented examples include a furniture positioning system and a snake game with a user-built maze in the real world. The proposed system is ideal for multimedia mobile applications where interaction is combined with the back camera of the device.

Paper Citation

in Harvard Style

Nóbrega R. and Correia N. (2013). Photo-based Multimedia Applications using Image Features Detection . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013) ISBN 978-989-8565-46-4, pages 298-307. DOI: 10.5220/0004244702980307

in Bibtex Style

@conference{grapp13,
author={Rui Nóbrega and Nuno Correia},
title={Photo-based Multimedia Applications using Image Features Detection},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)},
year={2013},
pages={298-307},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004244702980307},
isbn={978-989-8565-46-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)
TI - Photo-based Multimedia Applications using Image Features Detection
SN - 978-989-8565-46-4
AU - Nóbrega R.
AU - Correia N.
PY - 2013
SP - 298
EP - 307
DO - 10.5220/0004244702980307