Publish/Subscribe Messaging as a Basis for TeraGrid Information Services

Project Information

Discipline

Computer Science (401) 

Orientation

Research 

"This project will use FutureGrid to evaluate the possibility of using a messaging service as the basis for TeraGrid information services. The goal is to determine whether a publish/subscribe messaging approach is more effective than the approach currently used in TeraGrid to gather information from distributed TeraGrid resources and provide this information to TeraGrid users and services.The project will initially implement a proof of concept where the messaging service is installed in a virtual machine on FutureGrid and information from TeraGrid resources is published to that messaging service. The project will subsequently evaluate the latency, throughput, and scalability of different messaging service implementations and configurations. Messaging services that support the AMQP protocol will be evaluated. "

This work will produce quantitative information about the effectiveness of using a messaging system as the base layer of the information service for a large-scale cyberinfrastructure. This work will be published via technical reports and/or workshop, conference, or journal publications.

Improvements to the TeraGrid information services will help TeraGrid users, science gateways, and tool developers. This will result in more science being performed on TeraGrid.

Project Contact

Project Lead

Warren Smith (wsmith) 

Project Manager

Warren Smith (wsmith) 

Resource Requirements

Hardware Systems

• hotel (IBM iDataPlex at U Chicago)
• india (IBM iDataPlex at IU)
• sierra (IBM iDataPlex at SDSC)

 

"This project will use FutureGrid to evaluate the possibility of using a messaging service as the basis for TeraGrid information services. The goal is to determine whether a publish/subscribe messaging approach is more effective than the approach currently used in TeraGrid to gather information from distributed TeraGrid resources and provide this information to TeraGrid users and services.The project will initially implement a proof of concept where the messaging service is installed in a virtual machine on FutureGrid and information from TeraGrid resources is published to that messaging service. The project will subsequently evaluate the latency, throughput, and scalability of different messaging service implementations and configurations. Messaging services that support the AMQP protocol will be evaluated. "

"The initial phase of this project will only require a single VM to run the messaging service. This VM will be instantiated for 4-6 hours at a time while I perform experiments that have TeraGrid resources publishing information to it. I expect this phase to last for approximately 2 months and to instantiate this VM roughly 2 days a week.During performance evaluation, I expect to use 9-17 VMs for an hour or two at a time. One virtual machine will be running the messaging service and 8-16 virtual machines will be emulating TeraGrid resources publishing information and TeraGrid users/tools consuming information. I expect this phase to last for approximately 2 months and to instantiate VMs for 2-3 hours at a time 2 or 3 days a week."

Project Timeline

Submitted

11/05/2010 - 10:26