SDCI NMI Improvement: Pegasus: From Concept to Execution- - -Mapping Scientific Workflows onto the National Cyberinfrastructure

Project Information

Discipline
Computer Science (401) 
Orientation
Research 
Abstract

This project addresses improvements to Pegasus, a workflow system overlaying a workflow engine called DAGMan. These improvements will make Pegasus easy to deploy and use across a broad range of science users and environments. New debug capabilities will be added, usability will be improved, new communities of users will be directly engaged, richer workflow representations will be supported, dynamic workflows will be supported, priority-based task submission capabilities will be added, monitoring will be enhanced, and integration with emerging workflow technologies will be pursued. Intellectual merit lies in the demonstrated value to physics, astronomy, and other users. Broad impact of this proposal includes extension of the user base across new communities, including those using TeraGrid and OSG.

Intellectual Merit

(provided later)

Broader Impacts

(provided later)

Project Contact

Project Lead
Mats Rynge (rynge) 
Project Manager
Mats Rynge (rynge) 
Project Members
Parag Mhashilkar, Mats Rynge, Bartosz Balis, Maciej Malawski, Michal Niec, Robert Schuler, Idafen Santana Perez  

Resource Requirements

Hardware Systems
  • hotel (IBM iDataPlex at U Chicago)
  • india (IBM iDataPlex at IU)
  • sierra (IBM iDataPlex at SDSC)
  • xray (Cray XM5 at IU)
 
Use of FutureGrid

Workflows

Scale of Use

Testing, specifically growing/shrinking the resource pool based on demand.

Project Timeline

Submitted
10/08/2010 - 15:46