DREAMS: Run-time Partitioning Skew Mitigation
Journal: International Journal for Scientific Research and Development | IJSRD (Vol.3, No. 11)Publication Date: 2016-02-01
Authors : Rutul D. Dhomse;
Page : 376-379
Keywords : DREAMS; Skew; Virtualized;
Abstract
MapReduce has turned into a mainstream model for largescale information handling as of late. Be that as it may, existing MapReduce schedulers still experience the ill effects of an issue known as parceling skew, where the yield of guide errands is unevenly dispersed among diminishes undertakings. In this paper, we introduce DREAMS, a structure that gives run-time apportioning skew alleviation. Dissimilar to past methodologies that attempt to adjust the workload of reducers by repartitioning the transitional information allotted to each lessen errand, in DREAMS we adapt to parceling skew by changing assignment run-time asset designation. We demonstrate that our methodology permits DREAMS to take out the overhead of information repartitioning. Through trials utilizing both genuine and engineered workloads running on a 11-hub virtual virtualized Hadoop group, we demonstrate that DREAMS can adequately moderate negative effect of dividing skew, in this way enhancing work execution by up to 20:3%.
Other Latest Articles
- A literature review on Process parameter optimization of Powder Mixed Electric Discharge Machining (PMEDM) using design of experiment
- A Survey on Various Feature Selection Methodologies
- Effect of Aspiration Pressure on Convergent nozzle employed for gas atomization of Liquid Metals
- A Survey on Image Retrieval Techniques for Capturing User Intention
- A Review on Issues Related To Manual Core Making Process in Foundry Industry
Last modified: 2016-01-23 16:22:21