A Yet Faster Version of Complex-valued Multilayer Perceptron Learning using Singular Regions and Search Pruning

Seiya Satoh, Ryohei Nakano

2015

Abstract

In the search space of a complex-valued multilayer perceptron having J hidden units, C-MLP(J), there are singular regions, where the gradient is zero. Although singular regions cause serious stagnation of learning, there exist narrow descending paths from the regions. Based on this observation, a completely new learning method called C-SSF (complex singularity stairs following) 1.0 was proposed, which utilizes singular regions to generate starting points of C-MLP(J) search. Although C-SSF1.0 finds excellent solutions of successive C-MLPs, it takes long CPU time because the number of searches increases as J gets larger. To deal with this problem, C-SSF1.1 was proposed, a few times faster by the introduction of search pruning, but it still remained unsatisfactory. In this paper we propose a yet faster C-SSF1.3, going further with search pruning, and then evaluate the method in terms of solution quality and processing time.

Paper Citation

in Harvard Style

Satoh S. and Nakano R. (2015). A Yet Faster Version of Complex-valued Multilayer Perceptron Learning using Singular Regions and Search Pruning . In Proceedings of the 7th International Joint Conference on Computational Intelligence - Volume 3: NCTA, (ECTA 2015) ISBN 978-989-758-157-1, pages 122-129. DOI: 10.5220/0005594801220129

in Bibtex Style

@conference{ncta15,
author={Seiya Satoh and Ryohei Nakano},
title={A Yet Faster Version of Complex-valued Multilayer Perceptron Learning using Singular Regions and Search Pruning},
booktitle={Proceedings of the 7th International Joint Conference on Computational Intelligence - Volume 3: NCTA, (ECTA 2015)},
year={2015},
pages={122-129},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005594801220129},
isbn={978-989-758-157-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Joint Conference on Computational Intelligence - Volume 3: NCTA, (ECTA 2015)
TI - A Yet Faster Version of Complex-valued Multilayer Perceptron Learning using Singular Regions and Search Pruning
SN - 978-989-758-157-1
AU - Satoh S.
AU - Nakano R.
PY - 2015
SP - 122
EP - 129
DO - 10.5220/0005594801220129