DATA POOL: A STRUCTURE TO STORE VOLUMINOUS DATA

It is era of ‘Data Flood' which has given rise to Big Data. The paper presents a data structure named ‘Data Pool' to represent big data in memory while carrying out process. In the paper researcher has discussed implementation and results of the implementation with respect to space and time complexity of the structure. The structure is implemented for weather data. For weather forecasting process weather data is given as input using file formats, which is arranged in specific format. Before passing data as input, the structure can be applied to represent the data, which enables to represent maximum possible weather data with minimum possible memory space. To generalize the structure researchers implemented the structure for health data. The paper discusses results of the implementation with reference to space (memory) reduction as compared to original data, time consumed while processing data in Data Pool, and significant data loss with reference to original data and data represented in Data Pool.