Towards an Understanding of the Misclassification Rates of Machine Learning-based Malware Detection Systems

Nada Alruhaily, Behzad Bordbar, Tom Chothia

2017

Abstract

A number of machine learning based malware detection systems have been suggested to replace signature based detection methods. These systems have shown that they can provide a high detection rate when recognising non-previously seen malware samples. However, in systems based on behavioural features, some new malware can go undetected as a result of changes in behaviour compared to the training data. In this paper we analyse misclassified malware instances and we investigated whether there were recognisable patterns across these misclassifications. Several questions needed to be understood: Can we claim that malware changes over time directly affect the detection rate? Do changes that affect classification occur in malware at the level of families, where all instances that belong to certain families are hard to detect? Alternatively, can such changes be traced back to certain malware variants instead of families? Our experiments showed that these changes are mostly due to behavioural changes at the level of variants across malware families where variants did not behave as expected. This is can be due to the adoption of anti-virtualisation techniques, the fact that these variants were looking for a specific argument to be activated or it can be due to the fact that these variants were actually corrupted.

Paper Citation

in Harvard Style

Alruhaily N., Bordbar B. and Chothia T. (2017). Towards an Understanding of the Misclassification Rates of Machine Learning-based Malware Detection Systems . In Proceedings of the 3rd International Conference on Information Systems Security and Privacy - Volume 1: ICISSP, ISBN 978-989-758-209-7, pages 101-112. DOI: 10.5220/0006174301010112

in Bibtex Style

@conference{icissp17,
author={Nada Alruhaily and Behzad Bordbar and Tom Chothia},
title={Towards an Understanding of the Misclassification Rates of Machine Learning-based Malware Detection Systems},
booktitle={Proceedings of the 3rd International Conference on Information Systems Security and Privacy - Volume 1: ICISSP,},
year={2017},
pages={101-112},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006174301010112},
isbn={978-989-758-209-7},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Information Systems Security and Privacy - Volume 1: ICISSP,
TI - Towards an Understanding of the Misclassification Rates of Machine Learning-based Malware Detection Systems
SN - 978-989-758-209-7
AU - Alruhaily N.
AU - Bordbar B.
AU - Chothia T.
PY - 2017
SP - 101
EP - 112
DO - 10.5220/0006174301010112