A Bayesian Approach for Constructing Ensemble Neural Network

Sai Hung Cheung, Yun Zhang, Zhiye Zhao

2012

Abstract

Ensemble neural networks (ENNs) are commonly used in many engineering applications due to its better generalization properties compared with a single neural network (NN). As the NN architecture has a significant influence on the generalization ability of an NN, it is crucial to develop a proper algorithm to design the NN architecture. In this paper, an ENN which combines the component networks by using the Bayesian approach and stochastic modelling is proposed. The cross validation data set is used not only to stop the network training, but also to determine the weights of the component networks. The proposed ENN searches the best structure of each component network first and employs the Bayesian approach as an automating design tool to determine the best combining weights of the ENN. Peak function is used to assess the accuracy of the proposed ensemble approach. The results show that the proposed ENN outperforms ENN obtained by simple averaging and the single NN.

Download


Paper Citation


in Harvard Style

Hung Cheung S., Zhang Y. and Zhao Z. (2012). A Bayesian Approach for Constructing Ensemble Neural Network . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012) ISBN 978-989-8565-29-7, pages 374-377. DOI: 10.5220/0004147103740377

in Bibtex Style

@conference{kdir12,
author={Sai Hung Cheung and Yun Zhang and Zhiye Zhao},
title={A Bayesian Approach for Constructing Ensemble Neural Network},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012)},
year={2012},
pages={374-377},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004147103740377},
isbn={978-989-8565-29-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012)
TI - A Bayesian Approach for Constructing Ensemble Neural Network
SN - 978-989-8565-29-7
AU - Hung Cheung S.
AU - Zhang Y.
AU - Zhao Z.
PY - 2012
SP - 374
EP - 377
DO - 10.5220/0004147103740377