Online Eye Status Detection in the Wild with Convolutional Neural Networks

Essa R. Anas, Pedro Henriquez, Bogdan J. Matuszewski

2017

Abstract

A novel eye status detection method is proposed. Contrary to the most of the previous methods, this new method is not based on an explicit eye appearance model. Instead, the detection is based on a deep learning methodology, where the discriminant function is learned from a large set of exemplar images of eyes at different state, appearance, and 3D position. The technique is based on the Convolutional Neural Network (CNN) architecture. To assess the performance of the proposed method, it has been tested against two techniques, namely: SVM with SURF Bag of Features and Adaboost with HOG and LBP features. It has been shown that the proposed method outperforms these with a considerable margin on a two-class problem, with the two classes defined as “opened” and “closed”. Subsequently the CNN architecture was further optimised on a three-class problem with “opened”, “closed”, and “partially-opened” classes. It has been demonstrated that it is possible to implement a real-time eye status detection working with a large variability of head poses, appearances and illumination conditions. Additionally, it has been shown that an eye blinking estimation based on the proposed technique is at least comparable with the current state-of-the-art on standard eye blinking datasets.

Paper Citation

in Harvard Style

Anas E., Henriquez P. and Matuszewski B. (2017). Online Eye Status Detection in the Wild with Convolutional Neural Networks . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 88-95. DOI: 10.5220/0006172700880095

in Bibtex Style

@conference{visapp17,
author={Essa R. Anas and Pedro Henriquez and Bogdan J. Matuszewski},
title={Online Eye Status Detection in the Wild with Convolutional Neural Networks},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={88-95},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006172700880095},
isbn={978-989-758-227-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Online Eye Status Detection in the Wild with Convolutional Neural Networks
SN - 978-989-758-227-1
AU - Anas E.
AU - Henriquez P.
AU - Matuszewski B.
PY - 2017
SP - 88
EP - 95
DO - 10.5220/0006172700880095