ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

DREAMS: Run-time Partitioning Skew Mitigation

Journal: International Journal for Scientific Research and Development | IJSRD (Vol.3, No. 11)

Publication Date:

Authors : ;

Page : 376-379

Keywords : DREAMS; Skew; Virtualized;

Source : Downloadexternal Find it from : Google Scholarexternal

Abstract

MapReduce has turned into a mainstream model for largescale information handling as of late. Be that as it may, existing MapReduce schedulers still experience the ill effects of an issue known as parceling skew, where the yield of guide errands is unevenly dispersed among diminishes undertakings. In this paper, we introduce DREAMS, a structure that gives run-time apportioning skew alleviation. Dissimilar to past methodologies that attempt to adjust the workload of reducers by repartitioning the transitional information allotted to each lessen errand, in DREAMS we adapt to parceling skew by changing assignment run-time asset designation. We demonstrate that our methodology permits DREAMS to take out the overhead of information repartitioning. Through trials utilizing both genuine and engineered workloads running on a 11-hub virtual virtualized Hadoop group, we demonstrate that DREAMS can adequately moderate negative effect of dividing skew, in this way enhancing work execution by up to 20:3%.

Last modified: 2016-01-23 16:22:21