INTERPRETING EXTREME LEARNING MACHINE AS AN APPROXIMATION TO AN INFINITE NEURAL NETWORK

Elina Parviainen, Jaakko Riihimäki, Yoan Miche, Amaury Lendasse

2010

Abstract

Extreme Learning Machine (ELM) is a neural network architecture in which hidden layer weights are randomly chosen and output layer weights determined analytically. We interpret ELM as an approximation to a network with infinite number of hidden units. The operation of the infinite network is captured by neural network kernel (NNK). We compare ELM and NNK both as part of a kernel method and in neural network context. Insights gained from this analysis lead us to strongly recommend model selection also on the variance of ELM hidden layer weights, and not only on the number of hidden units, as is usually done with ELM. We also discuss some properties of ELM, which may have been too strongly interpreted in previous works.

Paper Citation

in Harvard Style

Parviainen E., Riihimäki J., Miche Y. and Lendasse A. (2010). INTERPRETING EXTREME LEARNING MACHINE AS AN APPROXIMATION TO AN INFINITE NEURAL NETWORK . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2010) ISBN 978-989-8425-28-7, pages 65-73. DOI: 10.5220/0003071100650073

in Bibtex Style

@conference{kdir10,
author={Elina Parviainen and Jaakko Riihimäki and Yoan Miche and Amaury Lendasse},
title={INTERPRETING EXTREME LEARNING MACHINE AS AN APPROXIMATION TO AN INFINITE NEURAL NETWORK},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2010)},
year={2010},
pages={65-73},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003071100650073},
isbn={978-989-8425-28-7},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2010)
TI - INTERPRETING EXTREME LEARNING MACHINE AS AN APPROXIMATION TO AN INFINITE NEURAL NETWORK
SN - 978-989-8425-28-7
AU - Parviainen E.
AU - Riihimäki J.
AU - Miche Y.
AU - Lendasse A.
PY - 2010
SP - 65
EP - 73
DO - 10.5220/0003071100650073