Egocentric Activity Recognition using Histograms of Oriented Pairwise Relations

Matthew Chapman, Ardhendu Behera, Anthony G. Cohn, David C. Hogg

2014

Abstract

This paper presents an approach for recognising activities using video from an egocentric (first-person view) setup. Our approach infers activity from the interactions of objects and hands. In contrast to previous approaches to activity recognition, we do not require to use an intermediate such as object detection, pose estimation, etc. Recently, it has been shown that modelling the spatial distribution of visual words corresponding to local features further improves the performance of activity recognition using the bag-of-visual words representation. Influenced and inspired by this philosophy, our method is based on global spatio-temporal relationships between visual words. We consider the interaction between visual words by encoding their spatial distances, orientations and alignments. These interactions are encoded using a histogram that we name the Histogram of Oriented Pairwise Relations (HOPR). The proposed approach is robust to occlusion and background variation and is evaluated on two challenging egocentric activity datasets consisting of manipulative task. We introduce a novel representation of activities based on interactions of local features and experimentally demonstrate its superior performance in comparison to standard activity representations such as bag-of-visual words.

Paper Citation

in Harvard Style

Chapman M., Behera A., G. Cohn A. and C. Hogg D. (2014). Egocentric Activity Recognition using Histograms of Oriented Pairwise Relations . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-004-8, pages 22-30. DOI: 10.5220/0004655100220030

in Bibtex Style

@conference{visapp14,
author={Matthew Chapman and Ardhendu Behera and Anthony G. Cohn and David C. Hogg},
title={Egocentric Activity Recognition using Histograms of Oriented Pairwise Relations},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={22-30},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004655100220030},
isbn={978-989-758-004-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)
TI - Egocentric Activity Recognition using Histograms of Oriented Pairwise Relations
SN - 978-989-758-004-8
AU - Chapman M.
AU - Behera A.
AU - G. Cohn A.
AU - C. Hogg D.
PY - 2014
SP - 22
EP - 30
DO - 10.5220/0004655100220030