A Walk in the Statistical Mechanical Formulation of Neural Networks - Alternative Routes to Hebb Prescription

Elena Agliari, Adriano Barra, Andrea Galluzzi, Daniele Tantari, Flavia Tavani

2014

Abstract

Neural networks are nowadays both powerful operational tools (e.g., for pattern recognition, data mining, error correction codes) and complex theoretical models on the focus of scientific investigation. As for the research branch, neural networks are handled and studied by psychologists, neurobiologists, engineers, mathematicians and theoretical physicists. In particular, in theoretical physics, the key instrument for the quantitative analysis of neural networks is statistical mechanics. From this perspective, here, we review attractor networks: starting from ferromagnets and spin-glass models, we discuss the underlying philosophy and we recover the strand paved by Hopfield, Amit-Gutfreund-Sompolinky. As a sideline, in this walk we derive an alternative (with respect to the original Hebb proposal) way to recover the Hebbian paradigm, stemming from mixing ferromagnets with spin-glasses. Further, as these notes are thought of for an Engineering audience, we highlight also the mappings between ferromagnets and operational amplifiers, hoping that such a bridge plays as a concrete prescription to capture the beauty of robotics from the statistical mechanical perspective.

Paper Citation

in Harvard Style

Agliari E., Barra A., Galluzzi A., Tantari D. and Tavani F. (2014). A Walk in the Statistical Mechanical Formulation of Neural Networks - Alternative Routes to Hebb Prescription . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014) ISBN 978-989-758-054-3, pages 210-217. DOI: 10.5220/0005077902100217

in Bibtex Style

@conference{ncta14,
author={Elena Agliari and Adriano Barra and Andrea Galluzzi and Daniele Tantari and Flavia Tavani},
title={A Walk in the Statistical Mechanical Formulation of Neural Networks - Alternative Routes to Hebb Prescription},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)},
year={2014},
pages={210-217},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005077902100217},
isbn={978-989-758-054-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)
TI - A Walk in the Statistical Mechanical Formulation of Neural Networks - Alternative Routes to Hebb Prescription
SN - 978-989-758-054-3
AU - Agliari E.
AU - Barra A.
AU - Galluzzi A.
AU - Tantari D.
AU - Tavani F.
PY - 2014
SP - 210
EP - 217
DO - 10.5220/0005077902100217