Investigation of the Optimal Number of Neuron in One-Hidden-Layer Artificial Neural Networks
Journal: Süleyman Demirel University Faculty of Arts and Science Journal of Science (Vol.17, No. 2)Publication Date: 2022-11.25
Authors : Tayfun Ünal; Ünver Çiftçi; Nurkut Nuray Urgan;
Page : 303-325
Keywords : Deep Learning; Artificial Neural Networks; Fully-Connected Layer; XOR Problem; Number of Neuron;
Abstract
In this paper, optimal number of neurons in one-hidden-layer artificial neural networks is investigated. Theoretical and statistical studies are carried out for this goal. Finding the global minimum is necessary in order to determine the optimal number of neurons. However, since the training of artificial neural networks is a non-convex problem, it is difficult to find a global minimum with optimization algorithms. In this study, an augmented cost function is proposed to find the global minimum, hence the optimal number of neurons. It is shown that the optimal number of neurons is produced by the artificial neural network model, which gives the global minimum with the aid of the augmented cost function. Additionally, the XOR and circle datasets are used to test the augmented cost function, and 99% success was achieved on the XOR dataset and 97% on the circle dataset. The optimal number of neurons is determined for these datasets.
Other Latest Articles
- Synthesis, Characterization and Investigation of Electrical Conductivity of Poly(2-Oxo-2-Phenyl Ethyl -2-Amino Benzoate)/Bentonite Nanocomposite
- Triple Lacunary Sequence Spaces for Fuzzy Numbers
- Damla Döküm Yöntemi ile Üretilen Perovskit Filmlerin Yaşlanma Süreçlerinin Elektriksel Karakterizasyon Teknikleri ile Belirlenmesi
- Anlı-Güngör Saçılma Formülü için Case metodu
- Ultrahızlı Optik Darbeler Kullanılarak Azot Molekülünden Yüksek Mertebeli Harmonik Üretimi
Last modified: 2022-12-08 18:02:46