Joint Color and Depth Segmentation based on Region Merging and Surface Fitting

Giampaolo Pagnutti, Pietro Zanuttigh

2016

Abstract

The recent introduction of consumer depth cameras has opened the way to novel segmentation approaches exploiting depth data together with the color information. This paper proposes a region merging segmentation scheme that jointly exploits the two clues. Firstly a set of multi-dimensional vectors is built considering the 3D spatial position, the surface orientation and the color data associated to each scene sample. Normalized cuts spectral clustering is applied to the obtained vectors in order to over-segment the scene into a large number of small segments. Then an iterative merging procedure is used to recombine the segments into the regions corresponding to the various objects and surfaces. The proposed algorithm tries to combine close compatible segments and uses a NURBS surface fitting scheme on the considered segments in order to understand if the regions candidate for the merging correspond to a single surface. The comparison with state-of-the-art methods shows how the proposed method provides an accurate and reliable scene segmentation.

Paper Citation

in Harvard Style

Pagnutti G. and Zanuttigh P. (2016). Joint Color and Depth Segmentation based on Region Merging and Surface Fitting . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 93-100. DOI: 10.5220/0005672700930100

in Bibtex Style

@conference{visapp16,
author={Giampaolo Pagnutti and Pietro Zanuttigh},
title={Joint Color and Depth Segmentation based on Region Merging and Surface Fitting},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={93-100},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005672700930100},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Joint Color and Depth Segmentation based on Region Merging and Surface Fitting
SN - 978-989-758-175-5
AU - Pagnutti G.
AU - Zanuttigh P.
PY - 2016
SP - 93
EP - 100
DO - 10.5220/0005672700930100