Big Data Problems: Understanding Hadoop Framework

THE IT INDUSTRY HAS SEEN REVOLUTION FROM MIGRATING FROM STANDARDIZATION TO INTEGRATION TO VIRTUALIZATION TO AUTOMATION TO THE CLOUD. NOW THE INDUSTRY IS ALL SET TO SPIN AROUND THE COMMERCIALIZATION THAT IS DATA ANALYTICS- BUSINESS INTELLIGENCE. FROM ALL FIELDS DATA IS GENERATING BE IT ANY INDUSTRY SECTOR. THUS VOLUME, VARIETY AND VELOCITY OF THE DATA HAVE BEEN EXTREMELY HIGH. THUS TO HANDLE SUCH ENORMOUS DATA WHERE TRADITIONAL DATABASES IS NOT POSSIBLE THE PROBLEM OF STORAGE, COMPUTION,LOW NETWORK BANDWIDTH AND LESS FAULT TOLERANT WHICH LEAD TO THE INTRODUCTION OF BIGDATA.IN THIS PAPER WE HAVE FOCUSED ON THE BACKEND ARCHITECTURE AND WORKING OF THE PARTS OF THE HADOOP FRAMEWORK WHICH ARE THEMAP REDUCE FOR THE COMPUTATIONAL AND ANALYTICS SECTION AND THE HADOOP DISTRIBUTED FILE SYSTEM (HDFS) FOR THE STORAGE SECTION.