Stream-based Active Learning in the Presence of Label Noise

Mohamed-Rafik Bouguelia, Yolande Belaïd, Abdel Belaïd

2015

Abstract

Mislabelling is a critical problem for stream-based active learning methods because it not only impacts the classification accuracy but also deviates the active learner from querying informative data. Dealing with label noise is omitted by most existing active learning methods. We address this issue and propose an efficient method to identify and mitigate mislabelling errors for active learning in the streaming setting. We first propose a mislabelling likelihood measure to characterize the potentially mislabelled instances. This measure is based on the degree of disagreement among the predicted and the queried class label (given by the labeller). Then, we derive a measure of informativeness that expresses how much the label of an instance needs to be corrected by an expert labeller. Specifically, an instance is worth relabelling if it shows highly conflicting information among the predicted and the queried labels. We show that filtering instances with a high mislabelling likelihood and correcting only the filtered instances with a high conflicting information greatly improves the performances of the active learner. Experiments on several real world data prove the effectiveness of the proposed method in terms of filtering efficiency and classification accuracy of the stream-based active learner.

Paper Citation

in Harvard Style

Bouguelia M., Belaïd Y. and Belaïd A. (2015). Stream-based Active Learning in the Presence of Label Noise . In Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-076-5, pages 25-34. DOI: 10.5220/0005178900250034

in Bibtex Style

@conference{icpram15,
author={Mohamed-Rafik Bouguelia and Yolande Belaïd and Abdel Belaïd},
title={Stream-based Active Learning in the Presence of Label Noise},
booktitle={Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2015},
pages={25-34},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005178900250034},
isbn={978-989-758-076-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Stream-based Active Learning in the Presence of Label Noise
SN - 978-989-758-076-5
AU - Bouguelia M.
AU - Belaïd Y.
AU - Belaïd A.
PY - 2015
SP - 25
EP - 34
DO - 10.5220/0005178900250034