Automatic Web Page Classification Using Visual Content

António Videira, Nuno Goncalves

2014

Abstract

There is a constantly increasing requirement for automatic classification techniques with greater classification accuracy. To automatically classify and process web pages, the current systems use the text content of those pages. However, little work has been done on using the visual content of a web page. On this account, our work is focused on performing web page classification using only their visual content. First a descriptor is constructed, by extracting different features from each page. The features used are the simple color and edge histograms, Gabor and Tamura features. Then two methods of feature selection, one based on the Chi-Square criterion, the other on the Principal Components Analysis are applied to that descriptor, to select the top discriminative attributes. Another approach involves using the Bag of Words (BoW) model to treat the SIFT local features extracted from each image as words, allowing to construct a dictionary. Then we classify web pages based on their aesthetic value, their recency and type of content. The machine learning methods used in this work are the Naive Bayes, Support Vector Machine, Decision Tree and AdaBoost. Different tests are performed to evaluate the performance of each classifier. Finally, we thus prove that the visual appearance of a web page has rich content not explored by current web crawlers based only on text content.

Paper Citation

in Harvard Style

Videira A. and Goncalves N. (2014). Automatic Web Page Classification Using Visual Content . In Proceedings of the 10th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST, ISBN 978-989-758-024-6, pages 193-204. DOI: 10.5220/0004856201930204

in Bibtex Style

@conference{webist14,
author={António Videira and Nuno Goncalves},
title={Automatic Web Page Classification Using Visual Content},
booktitle={Proceedings of the 10th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,},
year={2014},
pages={193-204},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004856201930204},
isbn={978-989-758-024-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,
TI - Automatic Web Page Classification Using Visual Content
SN - 978-989-758-024-6
AU - Videira A.
AU - Goncalves N.
PY - 2014
SP - 193
EP - 204
DO - 10.5220/0004856201930204