Evolution Strategies and Covariance Matrix Adaptation - Investigating New Shrinkage Techniques

Silja Meyer-Nieberg, Erik Kropat

2016

Abstract

This paper discusses the covariance matrix adaptation in evolution strategies, a central and essential mechanism for the search process. Basing the estimation of the covariance matrix on small samples w.r.t. the search space dimension is known to be problematic. However, this situation is common in optimization raising the question, whether the performance of the evolutionary algorithms could be improved. In statistics, several approaches have been developed recently to improve the quality of the maximum-likelihood estimate. However, they are seldom applied in evolutionary computation. Here, we focus on linear shrinkage which requires relatively little additional effort. Several approaches and shrinkage targets are integrated into evolution strategies and analyzed in a series of experiments.

Paper Citation

in Harvard Style

Meyer-Nieberg S. and Kropat E. (2016). Evolution Strategies and Covariance Matrix Adaptation - Investigating New Shrinkage Techniques . In Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-172-4, pages 105-116. DOI: 10.5220/0005703201050116

in Bibtex Style

@conference{icaart16,
author={Silja Meyer-Nieberg and Erik Kropat},
title={Evolution Strategies and Covariance Matrix Adaptation - Investigating New Shrinkage Techniques},
booktitle={Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2016},
pages={105-116},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005703201050116},
isbn={978-989-758-172-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Evolution Strategies and Covariance Matrix Adaptation - Investigating New Shrinkage Techniques
SN - 978-989-758-172-4
AU - Meyer-Nieberg S.
AU - Kropat E.
PY - 2016
SP - 105
EP - 116
DO - 10.5220/0005703201050116