A Study on the Role of Similarity Measures in Visual Text Analytics

F. San Roman S., R. D. de Pinho, R. Minghim, M. C. F. de Oliveira

2013

Abstract

Text Analytics is essential for a large number of applications and good approaches to obtain visual mappings of text are paramount. Many visualization techniques, such as similarity based point placement layouts, have proved useful to support visual analysis of documents. However, they are sensitive to data quality, which, in turn, relies on a critical preprocessing step that involves text cleaning and in some cases term detecting and weighting, as well as the definition of a similarity function. Not much has been discussed on the effect of these important similarity calculations in the quality of visual representations. This paper presents a study on the role of different text similarity measurements on the generation of visual text mappings. We focus mainly on two types of distance functions, those based on the well-known text vector representation and on direct string comparison measurements, comparing their effect on visual mappings obtained with point placement techniques. We find that both have their value but, in many circumstances, the vector space model (VSM) is the best solution when discrimination is important. However, the VSM is not incremental, that is, new additions to a collection force a recalculation of the whole feature space and similarities. In this work we also propose a new incremental model based on the VSM, which is shown to present the best visualization results in many configurations tested. We show the evaluation results and offer recommendations on the application of different text similarity measurements for Visual Text Analytics tasks.

Paper Citation

in Harvard Style

San Roman S. F., D. de Pinho R., Minghim R. and C. F. de Oliveira M. (2013). A Study on the Role of Similarity Measures in Visual Text Analytics . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2013) ISBN 978-989-8565-46-4, pages 429-438. DOI: 10.5220/0004214004290438

in Bibtex Style

@conference{ivapp13,
author={F. San Roman S. and R. D. de Pinho and R. Minghim and M. C. F. de Oliveira},
title={A Study on the Role of Similarity Measures in Visual Text Analytics},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2013)},
year={2013},
pages={429-438},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004214004290438},
isbn={978-989-8565-46-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2013)
TI - A Study on the Role of Similarity Measures in Visual Text Analytics
SN - 978-989-8565-46-4
AU - San Roman S. F.
AU - D. de Pinho R.
AU - Minghim R.
AU - C. F. de Oliveira M.
PY - 2013
SP - 429
EP - 438
DO - 10.5220/0004214004290438