ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

IMPLEMENTATION OF COMBINER FOR EFFICIENT BIG DATA PROCESSING IN HADOOP MAPREDUCE FRAMEWORK

Journal: International Journal OF Engineering Sciences & Management Research (Vol.2, No. 10)

Publication Date:

Authors : ;

Page : 16-22

Keywords : Big Data; Hadoop Framework; Online Aggregation; Combiners;

Source : Downloadexternal Find it from : Google Scholarexternal

Abstract

Big Data is a data that cannot be processed or analyzed by using traditional systems such as relational databases and data warehouses. The Big Data can be structured, unstructured or semi - structured. An open source, large data processing framework called Hadoop is been used to process large amounts of data. However, pro cessing jobs in Hadoop is time - consuming. In this paper I have proposed a Hadoop Online Aggregation Technique to decrease response time of Hadoop by executing the job partially. In Online Aggregation of Hadoop MapReduce an early result are made available t o the user before job completion. In online aggregation, Hadoop system processes a query in an online fashion. The processing of Hadoop is also benefited by adding the combiners in MapReduce paradigm. The proposed technique can reduce the total computing ti me taken by the Hadoop MapReduce framework

Last modified: 2015-09-28 15:11:51