Automatic Tag Extraction from Social Media for Visual Labeling

Shuhua Liu, Thomas Forss

2015

Abstract

Visual labeling or automated visual annotation is of great importance to the efficient access and management of multimedia content. Many methods and techniques have been proposed for image annotation in the last decade and they have shown reasonable performance on standard datasets. Great progress has been made especially in recent couple of years with the development of deep learning models for image content analysis and extraction of content-based concept labels. However, concept objects labels are much more friendly to machine than to users. We consider that more relevant and user-friendly visual labels need to include “context” descriptors. In this study we explore the possibilities to leverage social media content as a resource for visual labeling. We developed a tag extraction system that applies heuristic rules and term weighting method to extract image tags from associated Tweet. The system retrieves tweet-image pairs from public Twitter accounts, analyzes the Tweet, and generates labels for the images. We elaborate on different visual labeling methods, tag analysis and tag refinement methods.

Paper Citation

in Harvard Style

Liu S. and Forss T. (2015). Automatic Tag Extraction from Social Media for Visual Labeling . In Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, (IC3K 2015) ISBN 978-989-758-158-8, pages 504-510. DOI: 10.5220/0005638505040510

in Bibtex Style

@conference{kdir15,
author={Shuhua Liu and Thomas Forss},
title={Automatic Tag Extraction from Social Media for Visual Labeling},
booktitle={Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, (IC3K 2015)},
year={2015},
pages={504-510},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005638505040510},
isbn={978-989-758-158-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, (IC3K 2015)
TI - Automatic Tag Extraction from Social Media for Visual Labeling
SN - 978-989-758-158-8
AU - Liu S.
AU - Forss T.
PY - 2015
SP - 504
EP - 510
DO - 10.5220/0005638505040510