Human Activity Recognition using Deep Neural Network with Contextual Information

Li Wei, Shishir K. Shah

2017

Abstract

Human activity recognition is an important yet challenging research topic in the computer vision community. In this paper, we propose context features along with a deep model to recognize the individual subject activity in the videos of real-world scenes. Besides the motion features of the subject, we also utilize context information from multiple sources to improve the recognition performance. We introduce the scene context features that describe the environment of the subject at global and local levels. We design a deep neural network structure to obtain the high-level representation of human activity combining both motion features and context features. We demonstrate that the proposed context feature and deep model improve the activity recognition performance by comparing with baseline approaches. We also show that our approach outperforms state-of-the-art methods on 5-activities and 6-activities versions of the Collective Activities Dataset.

Paper Citation

in Harvard Style

Wei L. and K. Shah S. (2017). Human Activity Recognition using Deep Neural Network with Contextual Information . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-226-4, pages 34-43. DOI: 10.5220/0006099500340043

in Bibtex Style

@conference{visapp17,
author={Li Wei and Shishir K. Shah},
title={Human Activity Recognition using Deep Neural Network with Contextual Information},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={34-43},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006099500340043},
isbn={978-989-758-226-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, (VISIGRAPP 2017)
TI - Human Activity Recognition using Deep Neural Network with Contextual Information
SN - 978-989-758-226-4
AU - Wei L.
AU - K. Shah S.
PY - 2017
SP - 34
EP - 43
DO - 10.5220/0006099500340043