Knowing What You Don’t Know - Novelty Detection for Action Recognition in Personal Robots

Thomas Moerland, Aswin Chandarr, Maja Rudinac, Pieter Jonker

2016

Abstract

Novelty detection is essential for personal robots to continuously learn and adapt in open environments. This paper specifically studies novelty detection in the context of action recognition. To detect unknown (novel) human action sequences we propose a new method called background models, which is applicable to any generative classifier. Our closed-set action recognition system consists of a new skeleton-based feature combined with a Hidden Markov Model (HMM)-based generative classifier, which has shown good earlier results in action recognition. Subsequently, novelty detection is approached from both a posterior likelihood and hypothesis testing view, which is unified as background models. We investigate a diverse set of background models: sum over competing models, filler models, flat models, anti-models, and some reweighted combinations. Our standard recognition system has an inter-subject recognition accuracy of 96% on the Microsoft Research Action 3D dataset. Moreover, the novelty detection module combining anti-models with flat models has 78% accuracy in novelty detection, while maintaining 78% standard recognition accuracy as well. Our methodology can increase robustness of any current HMM-based action recognition system against open environments, and is a first step towards an incrementally learning system.

Paper Citation

in Harvard Style

Moerland T., Chandarr A., Rudinac M. and Jonker P. (2016). Knowing What You Don’t Know - Novelty Detection for Action Recognition in Personal Robots . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 317-327. DOI: 10.5220/0005677903170327

in Bibtex Style

@conference{visapp16,
author={Thomas Moerland and Aswin Chandarr and Maja Rudinac and Pieter Jonker},
title={Knowing What You Don’t Know - Novelty Detection for Action Recognition in Personal Robots},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={317-327},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005677903170327},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Knowing What You Don’t Know - Novelty Detection for Action Recognition in Personal Robots
SN - 978-989-758-175-5
AU - Moerland T.
AU - Chandarr A.
AU - Rudinac M.
AU - Jonker P.
PY - 2016
SP - 317
EP - 327
DO - 10.5220/0005677903170327