High-Performance Event Processing

nplex is the core data processing workhorse of many applications developed by DySI. The nplex SDK contains a library for quickly constructing complex event processing applications that can meet the highest performance requirements in terms of execution speeds, latencies and sheer data volume. The nplex SDK is used in most of the projects DySI participates in.

Application Areas
Valuable assets deserve accurate control based on just the right evidence derived from process, environment or market information. nplex offers extremely fast calculation of multitudes of indicators, pattern recognition and trigger generation. Intelligent dashboard applications can be constructed providing key management information in real-time leading to much improved operational intelligence.
nplex is one of the enablers of SmartCycle systems and wide area sensor networks. The vast amounts of sensor data obtained from the underlying processes or installations requires event processing chains to obtain the condensed information used in modeling and decision support. nplex provides high performance processing of these large volumes of data.
Transaction systems are another category of applications where nplex adds value. Businesses cannot afford to have customers waiting nor can they afford to rely incorrect inventory information. Truly complex transaction processing networks can be implemented using nplex that allow you to manage your processes while still meeting strict real-time requirements.

Features

• Real-time operation


• High performance for both computation oriented and detection oriented event processing


• Designed for multi-core hardware


• Handling of multiple data types such as events, data samples/tuples, data windows and data streams


• Network constructs for stream splits, merge, forks etc.


• Digital Signal Processing toolbox


• Smooth transition between temporal storage and persistent storage


• Support dedicated high-throughput databse systems smoothly combined with market leading database systems


• Quick integration with external libraries for signal processing or data analysis


• Integration with matlab for signal processing and analysis


• Integration with OfficeGrid and BlackBoard


• API for C/C++ and matlab

High Performance
"extremely demanding applications are supported by consequent use of high-performance software techniques." The nplex design is based on research done for the LOFAR radio-telescope project. This extremely demanding instrument generates an aggregated data stream of well over 20 Gbyte/s, fed into a cluster of server grade PC's; at the time Pentium D type processors. The central processing step in the LOFAR telescope is a pure software correlator running on an IBM Blue Gene supercomputer (see e.g. IBM System Blue Gene Solution). The data handling techniques developed to meet these requirements have been adopted and refined for nplex. Further improvement has been made in effective use of multi-core hardware resources that are common in current-day processors. An inventive inherently multi-threaded design for the data-flow handling has been created by DySI. Data rates of over 120 MByte/s per machine are achieved with good scaling to parallel hardware architectures such as clusters.

More information

Send us an email