IMPLEMENTATION OF COMBINER FOR EFFICIENT BIG DATA PROCESSING IN HADOOP MAPREDUCE FRAMEWORK
Journal: International Journal OF Engineering Sciences & Management Research (Vol.2, No. 10)Publication Date: 2015-10-30
Authors : Harshawardhan S. Bhosale;
Page : 16-22
Keywords : Big Data; Hadoop Framework; Online Aggregation; Combiners;
Abstract
Big Data is a data that cannot be processed or analyzed by using traditional systems such as relational databases and data warehouses. The Big Data can be structured, unstructured or semi - structured. An open source, large data processing framework called Hadoop is been used to process large amounts of data. However, pro cessing jobs in Hadoop is time - consuming. In this paper I have proposed a Hadoop Online Aggregation Technique to decrease response time of Hadoop by executing the job partially. In Online Aggregation of Hadoop MapReduce an early result are made available t o the user before job completion. In online aggregation, Hadoop system processes a query in an online fashion. The processing of Hadoop is also benefited by adding the combiners in MapReduce paradigm. The proposed technique can reduce the total computing ti me taken by the Hadoop MapReduce framework
Other Latest Articles
- MAGN EGAS AS AN ALTERNATIVE FUEL
- VULVOVAGINAL CANDIDIASIS AS A COMPLICATION OF SEXUAL TRANSMITTED DISEASES IN WOMEN REFERRED TO GYNECOLOGY CLINIC IN SOUTHEAST OF IRAN
- Round Robin Scheduling Algorithm to Control Processes that Grow Non-Deterministically
- Increased Knowledge and Awareness of Celiac Disease will Benefit the Elderly
- Major Problems to the Clinical Reassessment of Celiac Disease in Elderly
Last modified: 2015-09-28 15:11:51