Lightning CEP - High Performance&Low Latency Complex Event Processor
Journal: International Journal of Science and Research (IJSR) (Vol.3, No. 11)Publication Date: 2014-11-05
Authors : Vikas Kale; Kishor Shedge;
Page : 1219-1223
Keywords : CEP; Complex Event Processing; Stream Processing;
Abstract
Number of users and devices connected to internet is growing exponentially. Each of these device and user generate lot of data which organizations want to analyze and use. Hadoop like batch processing are evolved to process such big data. Batch processing systems provide offline data processing capability. There are many businesses which requires real-time or near real-time processing of data for faster decision making. Hadoop and batch processing system are not suitable for this. Stream processing systems are designed to support class of applications which requires fast and timely analysis of high volume data streams. Complex event processing, or CEP, is event/stream processing that combines data from multiple sources to infer events or patterns that suggest more complicated circumstances. In this paper I propose Lightning - High Performance& Low Latency Complex Event Processor engine. Lightning is based on open source stream processor WSO2 Siddhi. Lightning retains most of API and Query Processing of WSO2 Siddhi. WSO2 Siddhi core is modified using low latency technique such as Ring Buffer, off heap data store and other techniques.
Other Latest Articles
- Review on Intrusion Detection Using Fuzzy ARTMAP with Feature Selection Technique
- Modelling Exchange Rate Volatility Using Asymmetric GARCH Models (Evidence from Sierra Leone)
- A Split Canny Edge Detection: Algorithm and its FPGA Implementation
- Impact of ICDS on Developmental Milestones of Children under Five (2-5Yrs) in Telangana
- Web Data Extraction by Using Trinity
Last modified: 2021-06-30 21:12:54