Lightning CEP - Designing Filter and Window Operations

Number of users and devices connected to internet is growing exponentially. Each of these device and user generate lot of data which organizations want to analyze and use. There are many businesses which requires real-time or near real-time processing of data for faster decision making. Stream processing systems are designed to support class of applications which requires fast and timely analysis of high volume data streams. Complex event processing, or CEP, is event/stream processing that combines data from multiple sources to infer events or patterns that suggest more complicated circumstances. In this paper we describe how we can design filter and window operations for Lightning - High Performance & Low Latency Complex Event Processor.