A multivariate binary decision tree classifier based on shallow neural network
Journal: Scientific and Technical Journal of Information Technologies, Mechanics and Optics (Vol.22, No. 4)Publication Date: 2022-08-26
Authors : Marakhimov A.R. Kudaybergenov J.K. Khudaybergenov K.K. Ohundadaev U.R.;
Page : 725-733
Keywords : hierarchical classifier; neural networks; binary tree; multivariate decision tree; activation function;
Abstract
In this paper, a novel decision tree classifier based on shallow neural networks with piecewise and nonlinear transformation activation functions are presented. A shallow neural network is recursively employed into linear and non-linear multivariate binary decision tree methods which generates splitting nodes and classifier nodes. Firstly, a linear multivariate binary decision tree with a shallow neural network is proposed which employs a rectified linear unit function. Secondly, there is presented a new activation function with non-linear property which has good generalization ability in learning process of neural networks. The presented method shows high generalization ability for linear and non-linear multivariate binary decision tree models which are called a Neural Network Decision Tree (NNDT). The proposed models with high generalization ability ensure the classification accuracy and performance. A novel split criterion of generating the nodes which focuses more on majority objects of classes on the current node is presented and employed in the new NNDT models. Furthermore, a shallow neural network based NNDT models are converted into a hyperplane based linear and non-linear multivariate decision trees which has high speed in the processing classification decisions. Numerical experiments on publicly available datasets have showed that the presented NNDT methods outperform the existing decision tree algorithms and other classifier methods
Other Latest Articles
- Strengthening the role of microarchitectural stages of embedded systems design
- Applying the FN-Corrector to improve the quality of audio event classification
- Development of a model for detecting network traffic anomalies in distributed wireless ad hoc networks
- A method for improving the efficiency of integrated processing of Earth remote sensing data in solving problems of spatial objects monitoring
- An algorithm for generating design solutions for data and design-production procedures management at the stages of the lifecycle of an electronic product
Last modified: 2022-08-29 17:35:33