Interesting Regression- and Model Trees Through Variable Restrictions

Rikard König, Ulf Johansson, Ann Lindqvist, Peter Brattberg

2015

Abstract

The overall purpose of this paper is to suggest a new technique for creating interesting regression- and model trees. Interesting models are here defined as models that fulfill some domain dependent restriction of how variables can be used in the models. The suggested technique, named ReReM, is an extension of M5 which can enforce variable constraints while creating regression and model trees. To evaluate ReReM, two case studies were conducted where the first concerned modeling of golf player skill, and the second modeling of fuel consumption in trucks. Both case studies had variable constraints, defined by domain experts, that should be fulfilled for models to be deemed interesting. When used for modeling golf player skill, ReReM created regression trees that were slightly less accurate than M5’s regression trees. However, the models created with ReReM were deemed to be interesting by a golf teaching professional while the M5 models were not. In the second case study, ReReM was evaluated against M5’s model trees and a semi-automated approach often used in the automotive industry. Here, experiments showed that ReReM could achieve a predictive performance comparable to M5 and clearly better than a semi-automated approach, while fulfilling the constraints regarding interesting models.

Paper Citation

in Harvard Style

König R., Johansson U., Lindqvist A. and Brattberg P. (2015). Interesting Regression- and Model Trees Through Variable Restrictions . In Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, (IC3K 2015) ISBN 978-989-758-158-8, pages 281-292. DOI: 10.5220/0005600302810292

in Bibtex Style

@conference{kdir15,
author={Rikard König and Ulf Johansson and Ann Lindqvist and Peter Brattberg},
title={Interesting Regression- and Model Trees Through Variable Restrictions},
booktitle={Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, (IC3K 2015)},
year={2015},
pages={281-292},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005600302810292},
isbn={978-989-758-158-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, (IC3K 2015)
TI - Interesting Regression- and Model Trees Through Variable Restrictions
SN - 978-989-758-158-8
AU - König R.
AU - Johansson U.
AU - Lindqvist A.
AU - Brattberg P.
PY - 2015
SP - 281
EP - 292
DO - 10.5220/0005600302810292