Coupling Camera-tracked Humans with a Simulated Virtual Crowd

Jorge Ivan Rivalcoba Rivas, Oriam De Gyves, Isaac Rudomín, Nuria Pelechano

2014

Abstract

Our objective with this paper is to show how we can couple a group of real people and a simulated crowd of virtual humans. We attach group behaviors to the simulated humans to get a plausible reaction to real people. We use a two stage system: in the first stage, a group of people are segmented from a live video, then a human detector algorithm extracts the positions of the people in the video, which are finally used to feed the second stage, the simulation system. The positions obtained by this process allow the second module to render the real humans as avatars in the scene, while the behavior of additional virtual humans is determined by using a simulation based on a social forces model. Developing the method required three specific contributions: a GPU implementation of the codebook algorithm that includes an auxiliary codebook to improve the background subtraction against illumination changes; the use of semantic local binary patterns as a human descriptor; the parallelization of a social forces model, in which we solve a case of agents merging with each other. The experimental results show how a large virtual crowd reacts to over a dozen humans in a real environment.

Paper Citation

in Harvard Style

Rivalcoba Rivas J., De Gyves O., Rudomín I. and Pelechano N. (2014). Coupling Camera-tracked Humans with a Simulated Virtual Crowd . In Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014) ISBN 978-989-758-002-4, pages 312-321. DOI: 10.5220/0004694403120321

in Bibtex Style

@conference{grapp14,
author={Jorge Ivan Rivalcoba Rivas and Oriam De Gyves and Isaac Rudomín and Nuria Pelechano},
title={Coupling Camera-tracked Humans with a Simulated Virtual Crowd},
booktitle={Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)},
year={2014},
pages={312-321},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004694403120321},
isbn={978-989-758-002-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)
TI - Coupling Camera-tracked Humans with a Simulated Virtual Crowd
SN - 978-989-758-002-4
AU - Rivalcoba Rivas J.
AU - De Gyves O.
AU - Rudomín I.
AU - Pelechano N.
PY - 2014
SP - 312
EP - 321
DO - 10.5220/0004694403120321