EMBEDDED INCREMENTAL FEATURE SELECTION FOR REINFORCEMENT LEARNING

Robert Wright, Steven Loscalzo, Lei Yu

2011

Abstract

Classical reinforcement learning techniques become impractical in domains with large complex state spaces. The size of a domain’s state space is dominated by the number of features used to describe the state. Fortunately, in many real-world environments learning an effective policy does not usually require all the provided features. In this paper we present a feature selection algorithm for reinforcement learning called Incremental Feature Selection Embedded in NEAT (IFSE-NEAT) that incorporates sequential forward search into neuroevolutionary algorithm NEAT. We provide an empirical analysis on a realistic simulated domain with many irrelevant and relevant features. Our results demonstrate that IFSE-NEAT selects smaller and more effective feature sets than alternative approaches, NEAT and FS-NEAT, and superior performance characteristics as the number of available features increases.

Download


Paper Citation


in Harvard Style

Wright R., Loscalzo S. and Yu L. (2011). EMBEDDED INCREMENTAL FEATURE SELECTION FOR REINFORCEMENT LEARNING . In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8425-40-9, pages 263-268. DOI: 10.5220/0003153402630268

in Bibtex Style

@conference{icaart11,
author={Robert Wright and Steven Loscalzo and Lei Yu},
title={EMBEDDED INCREMENTAL FEATURE SELECTION FOR REINFORCEMENT LEARNING},
booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2011},
pages={263-268},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003153402630268},
isbn={978-989-8425-40-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - EMBEDDED INCREMENTAL FEATURE SELECTION FOR REINFORCEMENT LEARNING
SN - 978-989-8425-40-9
AU - Wright R.
AU - Loscalzo S.
AU - Yu L.
PY - 2011
SP - 263
EP - 268
DO - 10.5220/0003153402630268