A Boundedness of a Batch Gradient Method with Smoothing L_(1?2)Regularization for Pi-sigma Neural Networks
Journal: International Journal of Science and Research (IJSR) (Vol.3, No. 11)Publication Date: 2014-11-05
Authors : Kh. Sh. Mohamed; Y. Sh. Mohammed; Abd Elmoniem A. Elzain; Mohamed El-Hafiz M. N; Elnoor. A. A. Noh;
Page : 819-825
Keywords : Batch gradient method; Pi-sigma neural network; L regularization; Boundedness;
Abstract
This paper considers a batch gradient method with L_ (12) regularization for Pi sigma neural networks. In origin, by introducing an L_ (12) regularization term involves absolute value and is not differentiable into the error function. A key point of this paper, specifically, the smoothing L_ (12) regularization is a term proportional to the norm of the weights. The role of the smoothing L_ (12) regularization term is to control the magnitude of the weights and to improve the generalization performance of the networks. The weights are proved to be bounded during the training process, thus the conditions that are required for convergence analysis of batch gradient method in literature are simplified.
Other Latest Articles
- Detection and Analysis of Urban Change in Remotely Sensed Imagery by Principal Component Analysis of Image Data
- Contra-Cyclical Capital Buffering Solutions for Banks
- Bayesian Approach for Spectrum Sensing in Cognitive Radio
- A Review of Web Service Recommendation Systems
- Study of Physico-Chemical Properties of Glycerol Ester Based Non-Ionic Gemini Surfactant
Last modified: 2021-06-30 21:12:54