ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

Investigation of the Optimal Number of Neuron in One-Hidden-Layer Artificial Neural Networks

Journal: Süleyman Demirel University Faculty of Arts and Science Journal of Science (Vol.17, No. 2)

Publication Date:

Authors : ; ; ;

Page : 303-325

Keywords : Deep Learning; Artificial Neural Networks; Fully-Connected Layer; XOR Problem; Number of Neuron;

Source : Downloadexternal Find it from : Google Scholarexternal


In this paper, optimal number of neurons in one-hidden-layer artificial neural networks is investigated. Theoretical and statistical studies are carried out for this goal. Finding the global minimum is necessary in order to determine the optimal number of neurons. However, since the training of artificial neural networks is a non-convex problem, it is difficult to find a global minimum with optimization algorithms. In this study, an augmented cost function is proposed to find the global minimum, hence the optimal number of neurons. It is shown that the optimal number of neurons is produced by the artificial neural network model, which gives the global minimum with the aid of the augmented cost function. Additionally, the XOR and circle datasets are used to test the augmented cost function, and 99% success was achieved on the XOR dataset and 97% on the circle dataset. The optimal number of neurons is determined for these datasets.

Last modified: 2022-12-08 18:02:46