LEARNING METHOD UTILIZING SINGULAR REGION OF MULTILAYER PERCEPTRON

Ryohei Nakano, Seiya Satoh, Takayuki Ohwaki

2011

Abstract

In a search space of multilayer perceptron having J hidden units, MLP(J), there exists a singular flat region created by the projection of the optimal solution of MLP(J-1). Since such a singular region causes serious slowdown for learning methods, a method for avoiding the region has been aspired. However, such avoiding does not guarantee the quality of the final solution. This paper proposes a new learning method which does not avoid but makes good use of singular regions to find a solution good enough for MLP(J). The potential of the method is shown by our experiments using artificial data sets, XOR problem, and a real data set.

Paper Citation

in Harvard Style

Nakano R., Satoh S. and Ohwaki T. (2011). LEARNING METHOD UTILIZING SINGULAR REGION OF MULTILAYER PERCEPTRON . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011) ISBN 978-989-8425-84-3, pages 106-111. DOI: 10.5220/0003652501060111

in Bibtex Style

@conference{ncta11,
author={Ryohei Nakano and Seiya Satoh and Takayuki Ohwaki},
title={LEARNING METHOD UTILIZING SINGULAR REGION OF MULTILAYER PERCEPTRON},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011)},
year={2011},
pages={106-111},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003652501060111},
isbn={978-989-8425-84-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011)
TI - LEARNING METHOD UTILIZING SINGULAR REGION OF MULTILAYER PERCEPTRON
SN - 978-989-8425-84-3
AU - Nakano R.
AU - Satoh S.
AU - Ohwaki T.
PY - 2011
SP - 106
EP - 111
DO - 10.5220/0003652501060111