Activity Prediction using a Space-Time CNN and Bayesian Framework

Hirokatsu Kataoka, Yoshimitsu Aoki, Kenji Iwata, Yutaka Satoh

2016

Abstract

We present a technique to address the new challenge of activity prediction in computer vision field. In activity prediction, we infer the next human activity through "classified activities" and "activity data analysis.” Moreover, the prediction should be processed in real-time to avoid dangerous or anomalous activities. The combination of space--time convolutional neural networks (ST-CNN) and improved dense trajectories (iDT) are able to effectively understand human activities in image sequences. After categorizing human activities, we insert activity tags into an activity database in order to sample a distribution of human activity. A naive Bayes classifier allows us to achieve real-time activity prediction because only three elements are needed for parameter estimation. The contributions of this paper are: (i) activity prediction within a Bayesian framework and (ii) ST-CNN and iDT features for activity recognition. Moreover, human activity prediction in real-scenes is achieved with 81.0% accuracy.

Paper Citation

in Harvard Style

Kataoka H., Aoki Y., Iwata K. and Satoh Y. (2016). Activity Prediction using a Space-Time CNN and Bayesian Framework . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 461-469. DOI: 10.5220/0005671704610469

in Bibtex Style

@conference{visapp16,
author={Hirokatsu Kataoka and Yoshimitsu Aoki and Kenji Iwata and Yutaka Satoh},
title={Activity Prediction using a Space-Time CNN and Bayesian Framework},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={461-469},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005671704610469},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Activity Prediction using a Space-Time CNN and Bayesian Framework
SN - 978-989-758-175-5
AU - Kataoka H.
AU - Aoki Y.
AU - Iwata K.
AU - Satoh Y.
PY - 2016
SP - 461
EP - 469
DO - 10.5220/0005671704610469