KINETIC MORPHOGENESIS OF A MULTILAYER PERCEPTRON

Bruno Apolloni, Simone Bassis, Lorenzo Valerio

2011

Abstract

We introduce a morphogenesis paradigm for a neural network where neurons are allowed to move autonomously in a topological space to reach suitable reciprocal positions under an informative perspective. To this end, a neuron is attracted by the mates which are most informative and repelled by those which are most similar to it. We manage the neuron motion with a Newtonian dynamics in a subspace of a framework where topological coordinates match with those reckoning the neuron connection weights. As a result, we have a synergistic plasticity of the network which is ruled by an extended Lagrangian where physics components merge with the common error terms. With the focus on a multilayer perceptron, this plasticity is operated by an extension of the standard back-propagation algorithm which proves robust even in the case of deep architectures. We use two classic benchmarks to gain some insights on the morphology and plasticity we are proposing.

Paper Citation

in Harvard Style

Apolloni B., Bassis S. and Valerio L. (2011). KINETIC MORPHOGENESIS OF A MULTILAYER PERCEPTRON . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011) ISBN 978-989-8425-84-3, pages 99-105. DOI: 10.5220/0003642800990105

in Bibtex Style

@conference{ncta11,
author={Bruno Apolloni and Simone Bassis and Lorenzo Valerio},
title={KINETIC MORPHOGENESIS OF A MULTILAYER PERCEPTRON},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011)},
year={2011},
pages={99-105},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003642800990105},
isbn={978-989-8425-84-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011)
TI - KINETIC MORPHOGENESIS OF A MULTILAYER PERCEPTRON
SN - 978-989-8425-84-3
AU - Apolloni B.
AU - Bassis S.
AU - Valerio L.
PY - 2011
SP - 99
EP - 105
DO - 10.5220/0003642800990105