Apache Storm and Samza

Abstract

There are Distributed Stream Processing engines like Apache Storm, Apache S4 and Apache Samza created for processing large amounts of streaming data. Sensors are a source of large amounts of stream data generation. We would like to study and use the capabilities of the Dsitrbuted Stream processing systems in regards to Sensor Data Processing.

Intellectual Merit

We will look at running Distributed Stream Processing engines on FutureGrid nodes and develop stream processing algorithms for sensor data processing.

Broader Impact

Contribute to Open Source projects in the Apache Big Data Analytic stack.

Use of FutureGrid

Running the Distributed Stream Engines.

Scale Of Use

About 3 nodes

Publications

Project Number: FG-409

Project Lead: Supun Kamburugamuva

Institution: Indiana University

Project Status: Active

View Project Details

Project Members

Leif Christiansen

Oliver Lewis

Keywords

Apache Big Data Analytics Stack, stream processing

Timeline

Updated: 14 weeks 6 hours ago