Singularity Stairs Following with Limited Numbers of Hidden Units

Seiya Satoh, Ryohei Nakano

2014

Abstract

In a search space of a multilayer perceptron having J hidden units, MLP(J), there exist flat areas called singular regions that cause serious stagnation of learning. Recently a method called SSF1.3 utilizing singular regions has been proposed to systematically and stably find excellent solutions. SSF1.3 starts search from a search space of MLP(1), increasing J one by one. This paper proposes SSF2 that performs MLP search by utilizing singular regions with J changed bidirectionally within a certain range. The proposed method was evaluated using artificial and real data sets.

Paper Citation

in Harvard Style

Satoh S. and Nakano R. (2014). Singularity Stairs Following with Limited Numbers of Hidden Units . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014) ISBN 978-989-758-054-3, pages 180-186. DOI: 10.5220/0005075601800186

in Bibtex Style

@conference{ncta14,
author={Seiya Satoh and Ryohei Nakano},
title={Singularity Stairs Following with Limited Numbers of Hidden Units},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)},
year={2014},
pages={180-186},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005075601800186},
isbn={978-989-758-054-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)
TI - Singularity Stairs Following with Limited Numbers of Hidden Units
SN - 978-989-758-054-3
AU - Satoh S.
AU - Nakano R.
PY - 2014
SP - 180
EP - 186
DO - 10.5220/0005075601800186