Active Back-propagation Algorithm Based on Adjusting Error for Multilayer Feed-forward Neural Network
-
摘要: 研究误差反向传播多层前馈神经网络的主动式学习方法.文章分析了目前用于训练前馈神经网络改进BP算法的特点和存在的不足,在此基础上提出逐次主动调整网络学习误差的网络训练思想,根据网络输出误差趋势,主动变化输出层的调整误差δpl,使W\+k\-\{ji}和θ\+k\-j在调整过程中受到每次学习效果信息的控制,从而得到一种主动式变误差的学习算法.实验表明,在训练多层前馈神经网络时,变误差主动式算法的学习效率比改进BP算法的学习效率有明显提高.Abstract: The back-propagation (BP) algorithm was used as a learning algorithm in training multilayer feed-forward neural networks (MLFNN) in past years, and some improved BP algorithms have recently been developed to speed up MLFNN learning. However, the effeciency of these improved BP algorithms are limited due to ignoring the activity of adjusting error during training MLFNN. In this paper, an active back propagation (ABP) algorithm based on improved BP algorithm is developed for MLFNN trained. The ABP algorithm alters the adjusting errors of MLFNN during the network trained, according to the error tendency of the network, and aimed to enhance rapidity of the network trained. The paper describes experiments that compare the performance of ABP algorithm with improved BP algorithms. The experiment results have shown that the ABP algorithm gives more efficient than improved BP algorithm for MLFNN trained.
-
1 .Rumelhart De, McClelland Jl. Learning internal representation by error propagation.In:Rumelhart De,McClelland Jl,eds.Parallel Distributed Processing——Explorations in the Microstructure of Cognition. Vol. 1.Cambridge MA:MIT Press,1986.318~362 2. Baba N. A new approach for finding the global minimum of error function of neural networks.Neural Networks,1989,2(2):367~373 3. Hornik K, Stinhcombe M, White H.Multilayer feedforward networks are universal approximators. Neural Networks,1989,2(2):359~366 4. Minai Aa, Williams Rd.Acceleration of back propagation through learning rate and momentum adaptation.In:IEEE,eds.Proceedings of the International Joint Conference on Neural Networks.California:San Diego,1990.676~679 5. Lang Kj, Witbrock Mj. Faster learning variations on back-propagation: an empirical study.In:Toure tzky Ds,Hinton Ge,Sejnowski Tj,eds.Proc Connectionist Models Summer School. San Mateo:Morgan Kaufmann, 1988.52~59 6. Riedmiller M, Braun H. A direct adaptative method for faster backpropagation learning: the RPROP Algorithm.In:IEEE,eds.Proceedings of International Neural Networks. San francisco, 1993.586~591 7. Shiffman W, Joost M, Werner R. Optimization of the back propagation algorithm for training multilayer perceptrons.Proc European Symposium on Artificial Neural Networks, ESANN 93. Brussels,1993.97~104 -
点击查看大图
计量
- 文章访问数: 2883
- HTML全文浏览量: 29
- PDF下载量: 865
- 被引次数: 0
下载:
