A Bayesian Approach for Constructing Ensemble Neural Network
Sai Hung Cheung, Yun Zhang, Zhiye Zhao
2012
Abstract
Ensemble neural networks (ENNs) are commonly used in many engineering applications due to its better generalization properties compared with a single neural network (NN). As the NN architecture has a significant influence on the generalization ability of an NN, it is crucial to develop a proper algorithm to design the NN architecture. In this paper, an ENN which combines the component networks by using the Bayesian approach and stochastic modelling is proposed. The cross validation data set is used not only to stop the network training, but also to determine the weights of the component networks. The proposed ENN searches the best structure of each component network first and employs the Bayesian approach as an automating design tool to determine the best combining weights of the ENN. Peak function is used to assess the accuracy of the proposed ensemble approach. The results show that the proposed ENN outperforms ENN obtained by simple averaging and the single NN.
DownloadPaper Citation
in Harvard Style
Hung Cheung S., Zhang Y. and Zhao Z. (2012). A Bayesian Approach for Constructing Ensemble Neural Network . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012) ISBN 978-989-8565-29-7, pages 374-377. DOI: 10.5220/0004147103740377
in Bibtex Style
@conference{kdir12,
author={Sai Hung Cheung and Yun Zhang and Zhiye Zhao},
title={A Bayesian Approach for Constructing Ensemble Neural Network},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012)},
year={2012},
pages={374-377},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004147103740377},
isbn={978-989-8565-29-7},
}
in EndNote Style
TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012)
TI - A Bayesian Approach for Constructing Ensemble Neural Network
SN - 978-989-8565-29-7
AU - Hung Cheung S.
AU - Zhang Y.
AU - Zhao Z.
PY - 2012
SP - 374
EP - 377
DO - 10.5220/0004147103740377