ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

Hadoop Cluster Analysis and Assessment

Journal: International Journal of Modern Research in Engineering and Technology (Vol.3, No. 6)

Publication Date:

Authors : ; ;

Page : 33-37

Keywords : Bigdata; Hadoop; MapReduce; HDFS;

Source : Downloadexternal Find it from : Google Scholarexternal

Abstract

Large amount of data are produced daily from various fields such as science, economics, engineering and health. The main challenge of pervasive computing is to store and analyze large amount of data.This has led to the need for usable and scalable data applications and storage clusters. In this article, we examine the hadoop architecture developed to deal with these problems. The Hadoop architecture consists of the Hadoop Distributed File System (HDFS) and Mapreduce programming model, which enables storage and computation on a set of commodity computers. In this study, a Hadoop cluster consisting of four nodes was created.Regarding the data size and cluster size, Pi and Grep MapReduce applications, which show the effect of different data sizes and number of nodes in the cluster, have been made and their results examined.

Last modified: 2018-08-25 20:15:17