Association Rule Mining in Big Data using MapReduce approach in Hadoop
Journal: GRD Journal for Engineering (Vol.002, No. 1)Publication Date: 2016-12-18
Authors : J.Jenifer Nancy; M.Jansi Rani; Dr.D.Devaraj;
Page : 179-186
Keywords : Hadoop; MapReduce; Association rule mining; Data mining; big data;
Abstract
The concept of Association rule mining is an important task in data mining. In case of big data the large volume of data makes is impossible to generate rules at a faster pace. By making use of parallel execution in Hadoop using the MapReduce framework, the rules can be generated much faster and in an efficient way. The existing method transforms the input dataset into binomial representation before processing them using MapReduce. But binomial conversion is not user-friendly since it is complex in case of continuous values. In this paper, an improved and scalable algorithm is proposed for association rule mining that will convert the input dataset into key-value pairs instead of binomial. All the stages of proposed association rule mining algorithm are parallelized using MapReduce. The proposed algorithm works on high cardinality features and so no dimension detection is needed.
Citation: J.Jenifer Nancy, Kalasalingam University; M.Jansi Rani ,; Dr.D.Devaraj ,. "Association Rule Mining in Big Data using MapReduce approach in Hadoop." Global Research and Development Journal For Engineering : 179 - 186.
Other Latest Articles
- Tracking Coordinated and Adaptive Information using Security from Target Wireless sensor network
- ENHANCING EGRC USING ANOVA BASED CLUSTERING IN UNDERWATER SENSOR NETWORKS
- POWER FACTOR IMPROVEMENT IN THE RUBBER INDUSTRY USING FUZZY LOGIC
- Preparation of Papers for ICIET Conferences: Embedded Data With Image Using Chaos Based Particle Swarm Optimization(PSO)
- Security and Privacy Enhancing in Multi-Cloud Architecture with Data De-duplication
Last modified: 2016-12-18 16:59:37