Pegasus development and improvement platform

Abstract

This project is to give all members of the Pegasus team unified access to FutureGrid resources under one project umbrella. We believe that FutureGrid can be a valuable pool of resources to help us run automatic tests of our Pegasus software build process, and by virtue of being a cloud hosting VM, contribute to a wide variety of OS flavors to build binary bundles for. This is a repetitive operation likely over the lifetime of FutureGrid.

Intellectual Merit

a) Pegasus is a workflow system that can be used as part of the FG experiment management. We are developing a framework that will allow repeatable experiments
b) Pegasus can run workflows on Grids

Broader Impact

By using FG-provided resources, we expect to improve the Pegasus software stack, because it enables us to explore more difficult to test for problems.

Use of FutureGrid

I can see three essential use-cases:
[1] bringing up a couple of small resource uniform VM for build-integrated testing.
[2] bringing up a couple of medium-size development heterogeneous VMs for cross-flavor packaging.
[3] bringing up a large number of uniform VM for domain science experiment runs. However, these will explore the computer-science, i.e. workflow, side of the experiments, disregarding any domain science results.

Scale Of Use

About a dozen of resources for a short duration. Some burstiness possible for occasional experiments, though we prefer to point our users to FutureGrid and have them apply for their own projects. However, if problems during such experiments occur, it is simpler for us to have access to our own project, and thus FutureGrid resources, in order to debug problems or test use-cases.

We might be able to help FutureGrid with scalability testing.

Publications


FG-189
Mats Rynge
USC
Active

Project Members

Gaurang Mehta
Gideon Juve
Karan Vahi
Weiwei Chen

Timeline

2 years 23 weeks ago