Color-based and Rotation Invariant Self-similarities

Xiaohu Song, Damien Muselet, Alain Tremeau

2017

Abstract

One big challenge in computer vision is to extract robust and discriminative local descriptors. For many applications such as object tracking, image classification or image matching, there exist appearance-based descriptors such as SIFT or learned CNN-features that provide very good results. But for some other applications such as multimodal image comparison (infra-red versus color, color versus depth, ...) these descriptors failed and people resort to using the spatial distribution of self-similarities. The idea is to inform about the similarities between local regions in an image rather than the appearances of these regions at the pixel level. Nevertheless, the classical self-similarities are not invariant to rotation in the image space, so that two rotated versions of a local patch are not considered as similar and we think that many discriminative information is lost because of this weakness. In this paper, we present a method to extract rotation-invariant self similarities. In this aim, we propose to compare color descriptors of the local regions rather than the local regions themselves. Furthermore, since this comparison informs us about the relative orientations of the two local regions, we incorporate this information in the final image descriptor in order to increase the discriminative power of the system. We show that the self similarities extracted by this way are very discriminative.

Paper Citation

in Harvard Style

Song X., Muselet D. and Tremeau A. (2017). Color-based and Rotation Invariant Self-similarities . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-225-7, pages 344-351. DOI: 10.5220/0006107503440351

in Bibtex Style

@conference{visapp17,
author={Xiaohu Song and Damien Muselet and Alain Tremeau},
title={Color-based and Rotation Invariant Self-similarities},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={344-351},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006107503440351},
isbn={978-989-758-225-7},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)
TI - Color-based and Rotation Invariant Self-similarities
SN - 978-989-758-225-7
AU - Song X.
AU - Muselet D.
AU - Tremeau A.
PY - 2017
SP - 344
EP - 351
DO - 10.5220/0006107503440351