Hybrid Person Detection and Tracking in H.264/AVC Video Streams

Philipp Wojaczek, Marcus Laumer, Peter Amon, Andreas Hutter, André Kaup

2015

Abstract

In this paper we present a new hybrid framework for detecting and tracking persons in surveillance video streams compressed according to the H.264/AVC video coding standard. The framework consists of three stages and operates in both the compressed and the pixel domain of the video. The combination of compressed and pixel domain represents the hybrid character. Its main objective is to significantly reduce the amount of computation required, in particular for frames and image regions with few people present. In its first stage the proposed framework evaluates the header information for each compressed frame in the video sequence, namely the macroblock type information. This results in a coarse binary mask segmenting the frame into foreground and background. Only the foreground regions are processed further in the second stage that searches for persons in the image pixel domain by applying a person detector based on the Implicit Shape Model. The third stage segments each detected person further with a newly developed method that fuses information from the first two stages. This helps obtaining a finer segmentation for calculating a color histogram suitable for tracking the person using the mean shift algorithm. The proposed framework was experimentally evaluated on a publicly available test set. The results demonstrate that the proposed framework reliably separates frames with and without persons such that the computational load is significantly reduced while the detection performance is kept.

Paper Citation

in Harvard Style

Wojaczek P., Laumer M., Amon P., Hutter A. and Kaup A. (2015). Hybrid Person Detection and Tracking in H.264/AVC Video Streams . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 478-485. DOI: 10.5220/0005296704780485

in Bibtex Style

@conference{visapp15,
author={Philipp Wojaczek and Marcus Laumer and Peter Amon and Andreas Hutter and André Kaup},
title={Hybrid Person Detection and Tracking in H.264/AVC Video Streams},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={478-485},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005296704780485},
isbn={978-989-758-089-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Hybrid Person Detection and Tracking in H.264/AVC Video Streams
SN - 978-989-758-089-5
AU - Wojaczek P.
AU - Laumer M.
AU - Amon P.
AU - Hutter A.
AU - Kaup A.
PY - 2015
SP - 478
EP - 485
DO - 10.5220/0005296704780485