A Multiple Instance Learning Approach to Image Annotation with Saliency Map

Tran Phuong Nhung, Cam-Tu Nguyen, Jinhee Chun, Ha Vu Le, Takeshi Tokuyama

2013

Abstract

This paper presents a novel approach to image annotation based on multi-instance learning (MIL) and saliency map. Image Annotation is an automatic process of assigning labels to images so as to obtain semantic retrieval of images. This problem is often ambiguous as a label is given to the whole image while it may only corresponds to a small region in the image. As a result, MIL methods are suitable solutions to resolve the ambiguities during learning. On the other hand, saliency detection aims at detecting foreground/background regions in images. Once we obtain this information, labels and image regions can be aligned better, i.e., foreground labels (background labels) are more sensitive to foreground areas (background areas). Our proposed method, which is based on an ensemble of MIL classifiers from two views (background/foreground), improves annotation performance in comparison to baseline methods that do not exploit saliency information.

Paper Citation

in Harvard Style

Phuong Nhung T., Nguyen C., Chun J., Le H. and Tokuyama T. (2013). A Multiple Instance Learning Approach to Image Annotation with Saliency Map . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval and the International Conference on Knowledge Management and Information Sharing - Volume 1: KDIR, (IC3K 2013) ISBN 978-989-8565-75-4, pages 152-159. DOI: 10.5220/0004543901520159

in Bibtex Style

@conference{kdir13,
author={Tran Phuong Nhung and Cam-Tu Nguyen and Jinhee Chun and Ha Vu Le and Takeshi Tokuyama},
title={A Multiple Instance Learning Approach to Image Annotation with Saliency Map},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval and the International Conference on Knowledge Management and Information Sharing - Volume 1: KDIR, (IC3K 2013)},
year={2013},
pages={152-159},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004543901520159},
isbn={978-989-8565-75-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval and the International Conference on Knowledge Management and Information Sharing - Volume 1: KDIR, (IC3K 2013)
TI - A Multiple Instance Learning Approach to Image Annotation with Saliency Map
SN - 978-989-8565-75-4
AU - Phuong Nhung T.
AU - Nguyen C.
AU - Chun J.
AU - Le H.
AU - Tokuyama T.
PY - 2013
SP - 152
EP - 159
DO - 10.5220/0004543901520159