A Survey on Big Data and Knowledge Acquisition Techniques

Abstract Abstract- Big data refers to a data sets that a large of traditional computer memory, processor and software, that's mean when the volume, variety and velocity of the data are increased, the current techniques and technologies may not be able to handle storage and processing of data, Also a Big Data described as more functionally, as large pools of unstructured and structured data that can be captured, communicated, aggregated, stored, and analyzed which are now becoming a part of every sector and function of the global economy. Due to the rapidly increasing and updating of the big data in real-life applications, it gives a new rise of challenge for quickly extracting the useful information from big data for decision making, so this research will navigate throw the big data design and structure moreover explore the different techniques that used to discover a useful knowledge from big data, that helps a decision maker for a good and fast decision. This survey will support the future research and development work as well as raising the awareness for the presented approaches. Index Terms- Big data, Hadoop, HDFS, MapReduce, Spark, Keywords: Big data, Hadoop, HDFS PIG, HIVE, SPARK, MapReduce, Knowledge discovery, Data mining, Fuzzy Set, Rough Set, Decision Tree,.ID3, C4.5, FCM.