Revisiting Pose Estimation with Foreshortening Compensation and Color Information

Achint Setia, Anoop R. Katti, Anurag Mittal

2014

Abstract

This paper addresses the problem of upper body pose estimation. The task is to detect and estimate 2D human configuration in static images for six parts: head, torso, and left-right upper and lower arms. The common approach to solve this has been the Pictorial Structure method (Felzenszwalb and Huttenlocher, 2005). We present this as a graphical model inference problem and use the loopy belief propagation algorithm for inference. When a human appears in fronto-parallel plane, fixed size part detectors are sufficient and give reliable detection. But when parts like lower and upper arms move out of the plane, we observe foreshortening and the part detectors become erroneous. We propose an approach that compensates foreshortening in the upper and lower arms, and effectively prunes the search state space of each part. Additionally, we introduce two extra pairwise constraints to exploit the color similarity information between parts during inference to get better localization of the upper and lower arms. Finally, we present experiments and results on two challenging datasets (Buffy and ETHZ Pascal), showing improvements on the lower arms accuracy and comparable results for other parts.

Paper Citation

in Harvard Style

Setia A., R. Katti A. and Mittal A. (2014). Revisiting Pose Estimation with Foreshortening Compensation and Color Information . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-004-8, pages 31-38. DOI: 10.5220/0004669300310038

in Bibtex Style

@conference{visapp14,
author={Achint Setia and Anoop R. Katti and Anurag Mittal},
title={Revisiting Pose Estimation with Foreshortening Compensation and Color Information},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={31-38},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004669300310038},
isbn={978-989-758-004-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)
TI - Revisiting Pose Estimation with Foreshortening Compensation and Color Information
SN - 978-989-758-004-8
AU - Setia A.
AU - R. Katti A.
AU - Mittal A.
PY - 2014
SP - 31
EP - 38
DO - 10.5220/0004669300310038